Company

Innovate It ConsultancySee more

addressAddressSydney, NSW
type Form of workFull time
salary Salary$100,000 - $150,000 a year
CategoryAccounting & Finance

Job description

1.Role: PySpark Developer
   Location: Sydney, Australia
  Total Experience: 3 - 5 Years
   Budget: AUD 76,000 Inclusive of Super per year

Job Description:

PySpark Development:

• Develop, implement, and maintain PySpark applications for processing large-scale datasets. 
• Write efficient PySpark code for data cleansing, transformation, and analysis tasks. 
 Cloud Environment Experience:

• Deploy and manage PySpark applications on cloud platforms, ensuring scalability and reliability. 
• Optimize PySpark jobs for performance within the cloud environment. 

Collaboration and Communication:

• Collaborate with data engineers, data scientists, and other stakeholders to understand project requirements and objectives. 
• Communicate effectively with team members and stakeholders to provide updates and gather feedback.

Azure Databricks (Good to have):

• Familiarity with Azure Databricks for big data processing is a plus. 
• Utilize Azure Databricks for efficient data processing and analytics tasks.

Airflow (Good to have):

• Knowledge of Airflow for workflow management and orchestration is desirable. 
• Design and implement workflows using Airflow to automate data pipelines. 

Qualifications and Skills:

• Bachelor's degree in Engineering (BE) or related field. 
• 3-5 years of experience with PySpark development. 
• Strong proficiency in Python programming language. 
• Experience working with cloud environments such as AWS or Azure. 
• Good understanding of distributed computing concepts. 
• Excellent problem-solving and analytical skills. 
• Effective communication and collaboration abilities. 
 Must have skills:

PySpark, Cloud Platform development experience using CI/CD.

Responsibilities Good communication skills and a fast learner Good to have Azure Data Bricks, Airflow. Knowledge of Telecom domain is a plus.

2.Role: .Net Support Lead
   Location: Sydney, Australia
  Total Experience: 7 - 10  Years
   Budget: AUD 120,000 – 130,000 + Super per Year.

Job Description:

Must have technical skills:

  • Excellent .NET skills including C#, .NET Core, ASP.NET MVC, WebAPI and Entity Framework. 
  • Working with Azure Kubernetes Service (AKS), Azure Service Bus. 
  • Experience with Azure Data Factory, Azure SQL DB, Azure DWH. 
  • Experience with Azure Monitors, Azure Application Insights, Azure ServiceBus. 
  • Experience building Azure Custom Activity to handle data movements.  
  • Experience with Azure Function App and Azure data factory. 
  • Experience working with data encryption and decryption using Custom Activity. 

Key responsibilities: 

  • Participate in agile ceremonies. 
  • Own the rollback on the production environment. 
  • Coordinate the deployment verification after production deployment.  
  • Own the DR & roll-back based on the need. 
  • Work on the root cause of problem records and reduce the incidents.  
  • Automate manual tasks carried out by Operations Team. 
  • Weekly reporting to Service Delivery and understand the strategic needs from Operations. 
  • Attend change walkthrough, Review change and implementation plan and approve. 
  • Participate in the major incident call and coordinate with different teams to fix the incident. 
  • Engage different vendor’s and external teams based on the nature of the incident. 
  • Participate in the PIR meeting to find the root cause. 
  • Business communication about major incidents during non-business hours. 
  • Work with Service Delivery Manager, Business, Customer Hub, Other stakeholders to prioritize the incidents and problems. 
  • Work as an on-call support person rotating shifts in a 24/7 environment


3.Role: System Integration Manager
   Location: Sydney, Australia
   Total Experience: 8 - 12 Years
   Relevant Experience: 7+ Years
   Budget: AUD 150,000 Inclusive of Super per Year.

Job Description:

Total Experience: 8-12 years 
Relevant Experience: 7+ years 

Detailed JD: 

The ideal candidate has the following experience:

• Understand the system architecture and integration of core banking system with other upstream and downstream systems. 
• Schedule workshop with multiple teams and plan the multiple stages of dress rehearsals, OAT acceptance , go-live activities. 
• Good communication skills. 
• Prepare detailed runbook with dependencies listed.
• Organise the OAT acceptance from different teams.

4.Role: Senior Payment - Compliance Specialist
   Location: Sydney, Australia
   Total Experience: 8+ Years
   Budget: AUD 122,000 Inclusive of Super per Year.


Job Description:

 Should have 8 years of experience and Payments domain knowledge. 

• Should have excellent understanding of below. '

-Swift message processing, 

- E2E processing of payment life cycle, 

- GPP fusion product knowledge along with GPP SP and Classic, 

- RTGS payment processing Cutoff time testing, 

- HVCS CBPR message processing, 

- Knowledge of clearing and settlements, 

- Day2 message processing after the cutoff time pass, 

- MTCover message, 

- Swift reporting, 

- Batch processing, 

- RMA, 

- User profile testing, 

- Knowledge of MQs, 

- Interface connection 

• Lead and manage the automation team for effective test automation planning, execution and Track the automation to meet the desired targets. 

• Participate in resource forecast planning and ensure sufficient capacity is available for future pipeline projects. 

• Familiar with test tools i.e. Jira, ALM. 

• Self-motivated, able to work off own initiative or as part of a team when required. 

Mandatory skills:

Banking domain with Payments end to end knowledge.

Refer code: 2057935. Innovate It Consultancy - The previous day - 2024-04-19 00:10

Innovate It Consultancy

Sydney, NSW
Popular Pyspark Developer jobs in top cities
Jobs feed

Maintenance Manager - Full-time

Kelsian

Darwin, NT

Permanent

Maintenance Manager - Full-time

Sealink

Larrakeyah, NT

Permanent

Maintenance Manager - Full-time

Sealink

Darwin, NT

Permanent

Fleet Workshop Manager

Downer Group

Brisbane, QLD

Permanent

Light Vehicle Technician [ Hampstead Gardens SA]

Atlam Group

Adelaide, SA

Permanent

Service Technician

Nov

Kalgoorlie, WA

Permanent

Electrical Maintenance Tradesperson

The Star Entertainment Group

Queensland

Permanent

Field Officer

Australian Plague Locust Commission

Longreach, QLD

$74,882-81,521 per year

Field Officer - Affirmative Measures Indigenous

Australian Plague Locust Commission

Broken Hill, NSW

$74,882-81,521 per year

Field Officer

Australian Plague Locust Commission

Narromine, NSW

$74,882-81,521 per year

Share jobs with friends