Pyspark Data Engineer jobs in Sydney, NSW

Now available 157 results are consistent

Sort by:relevance - date

DATA ENGINEER WITH PYSPARK

Experience in Pyspark, Cloud Platform development experience using CI/CDMust have experience in Pyspark DeveloperKnowledge of Telecom domain is a plusGood to have Azure Data Bricks, AirflowGood communication skills and a fast lear...

CompanyXpt Software Australia Pty Ltd
AddressSydney, NSW
CategoryEngineering
Job typeContract
Date Posted a month ago See detail

Data Engineer with Pyspark

Xpt Software Australia Pty Ltd

Sydney, NSW

Experience in Pyspark, Cloud Platform development experience using CI/CDMust have experience in Pyspark DeveloperKnowledge of Telecom domain is a plusGood to have Azure Data Bricks, AirflowGood communication skills and a fast lear...

Data Engineer HR Tech

Commonwealth Bank Of Australia

Sydney, NSW

Permanent

You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies. We're one of the largest and most advanced Data Engineering teams in the country. Together we can build state-of-the-art data solution...

Lead Data Engineer - Cloud

Ing

Sydney, NSW

Permanent

Business and systems analysis, development, and testing, combined with business risk assessments and data quality monitoring. Manage end to end software development and meet agreed Service Levels for the availability of the accura...

Data Engineer-Data Integration-Sydney-12mths FTH

Ibm

Sydney, NSW

Contract

Work effectively to drive solution architecture discussions face to face by interacting with several business stakeholders Assist in creating solutions for client and/or internal review. Participate in client meetings to communica...

Technical lead Data Engineer

Cognizant

Sydney, NSW

$100,000 per year

Experience in data profiling, source-target mappings, ETL development, SQL optimization, Performance Tuning, testing, and implementation. To build on CI/CD pipeline, Jenkins. Collaborate with team members on code branching, mergin...

Big Data/PySpark Senior Engineer

Westpac

Sydney, NSW

Strong Core Python development skills;. Strong understanding of PySpark/ Spark technologies. Strong understanding of cloud big data implementations/tools. Well versed in Data Structures, complexity theory and CS fundamentals;. Str...

Software Engineer III, Data Warehousing & Business Intelligence

Jpmorgan Chase

Sydney, NSW

Permanent

Work in a global team environment taking care of developing & maintaining client reports. Respond to end user enquiries. Understand and analyze business requirements and face off stakeholders. Proactively identifies issues/problem...

Electrical Engineer - Data Centres

Design & Build Recruitment

Sydney, NSW

Permanent

Develop comprehensive electrical system designs, ensuring compliance with relevant codes, standards, budgets, and client requirements. Conduct thorough technical analysis, including load calculations, power distribution studies, a...

Senior Data Engineer

Ethos Beathchapman

Sydney, NSW

Extensive experience working as a Data Engineer in an enterprise environment. Experience working with Azure Data Services, where you've implemented end-to-end solutions. Experience building ETL / ELT processes using PySpark - this...

Data Engineer

Minutes To Seconds

Sydney, NSW

Ensure reliable performance of the data warehouse through monitoring, performance tuning and intelligent scheduling of workloads.. Manage the existing data platform infrastructure and perform necessary upgrades. Manage and config...

Data Engineer

Suncorp

Sydney, NSW

Full-time 12-month contract. Flexible working locations of Brisbane, Sydney or Melbourne. Modern building with state of the art facilities. Manage monthly data processes, including external data extraction and daily updates. Main...

Data Engineer

Thedrivegroup

Sydney, NSW

A university degree in IT (or related). 5 + years of experience as a Data Engineer. Preference for GCP experience, although Azure or AWS is great too. Experience with Snowflake. Experience with Python and SQL. Strong ETL experien...

Senior Data Engineer

Northbridge Recruitment

Sydney, NSW

Use best practice methodologies and tools, including data modelling, science, statistical and reporting methodologies to identify trends, risks and opportunities providing expert analytics, reporting advice and insights to Fair Tr...

Data Engineer

Suncorp

Sydney, NSW

Full-time 12-month contract. Flexible working locations of Brisbane, Sydney or Melbourne. Modern building with state of the art facilities. Manage monthly data processes, including external data extraction and daily updates. Main...

Data Engineer

Nine For Brands

Sydney, NSW

Design, develop and maintain data pipelines that extract, load and transform data from various sources into the data warehouses. Design and implement data models that align with business requirements and support efficient querying...

Senior Data Engineer

Northbridge It Recruitment Propr

Sydney, NSW

Use best practice methodologies and tools, including data modelling, science, statistical and reporting methodologies to identify trends, risks and opportunities providing expert analytics, reporting advice and insights to Fair Tr...

Senior Data Engineer

Kapital Consulting

Sydney, NSW

Design, develop, and implement Azure solutions leveraging Azure Synapse, ADLS2, Spark (Python and Scala), and Cosmos DB. Utilise programming languages such as Python or Scala to create robust data products and demonstrate proficie...

Lead Data Engineer

Macquarie Group Limited

Sydney, NSW

Experience either leading significant Data Engineering projects in an enterprise environment. The ability to mentor and lead a team with best practices for Data Engineering and site reliability. Big Data and Hadoop experience wi...

Data Infrastructure (OSI-PI) Platform Engineer

Zone It Solutions

Sydney, NSW

Bachelor's degree in Computer Science, Information Technology, or a related field. Minimum 5 years of experience working as a Data Infrastructure Engineer or in a similar role. Strong knowledge of the OSI-PI platform and its compo...

Senior Mechanical Engineer, Data Centres

Mission Critical Recruitment

Sydney, NSW

Mechanical Engineering Degree. Working towards Professional Engineer or Chartership status (if not already gained). 5+ years' post graduate experience of building services design. Consulting or contractor experience. Experienced...

Staff Systems Engineer Data Protection

Commonwealth Bank Of Australia

Sydney, NSW

Access to world leading tools and technologies. Friendly, inclusive and collaborative work environment. Future focused and innovative team of experts in Data Protection. Provide strategic guidance on data storage initiatives and s...

Azure Data Engineer (Financial Services)

Perigon Group

Sydney, NSW

Permanent

Our client is a reputable Financial Services organisation on the lookout for Data Engineer to lead their Migration to Azure from On Premises MS SQL Server. 12 month FTC. You will be responsible for the migration of existing busine...

Mechanical Engineer | Data Centre's

Apac Fm Recruitment Pty Limited

Sydney, NSW

Work for a leading engineering consultancy firm to specialize in thriving data centre projects.. Work within your team on ambitious endeavours to achieve extraordinary results for prestigious clients and communities.. Success in...

Senior software engineer - data

Ing

Sydney, NSW

Contribute to the on boarding of the Azure, implementing best practices through design. Develop and improve team capabilities in skills and processes. Translating business requirements into technical solutions. Manage public cloud...

Software engineer - data services

Crowdstrike

Sydney, NSW

3+ years python development experience. You will be comfortable with concepts such as async processing, test driven development, and static typing. Proficiency in common backend tech stacks for RESTful API, storage, caching and da...

Data Engineer

V2 Digital

Sydney, NSW

Permanent

Advising our customers on their Data pain points. Supporting solution design sessions with our customers. Hands-on implementation of data solutions. Setting technical standards on the customer engagements. Providing technical lead...

Senior Data Engineer

Commonwealth Bank Of Australia

Haymarket, NSW

You are a data professional with strong proficiency in Teradata, Hadoop and DevOps environments. We're one of the largest and most advanced Data Engineering teams in the country. Together we can build state-of-the-art data solutio...

Senior Associate Consultant- Data Engineer

Infosys

Sydney, NSW

Permanent

Experienced in data analysis. Experienced in SQL Script Analysis to understand the business logic. Experienced in Unix jobs analysis. Must have good hands-on experience on writing PySpark, PL/SQL, UNIX Shell scripting, Git & Jenki...

Senior Data Engineer, Sydney

Graincorp

Barangaroo, NSW

As we find new ways to connect rural communities with food, animal feed and industrial customers around the world, we are proud to say were leading the way in sustainable agriculture.About the roleGrainCorp is currently seeking a...

Senior Data Engineer

Mantel Operations Pty Ltd

Sydney, NSW

Permanent

Work with clients to understand their requirements, explain trade-offs for different options and ensure you deliver a solution that they value and will use? Focus on compassion and empathy in your interactions with othersWe value...