ETL Developer Job at PERCEPT SOLUTIONS PTE. LTD., West Islip, NY

VHRxUTBBcS9xKzRwaFhGMG8yb2UwSm0yQ3c9PQ==
  • PERCEPT SOLUTIONS PTE. LTD.
  • West Islip, NY

Job Description

We are seeking a skilled and motivated ETL Developer with a strong background in data engineering. The ideal candidate should have hands-on experience with Kafka, SQL Programming, MySQL, Linux scripting, data modeling, and some Java programming for writing Kafka connectors. In addition, the candidate should be familiar with Airflow or other orchestration tools, Azure DevOps, and CI/CD pipeline implementation. This role will involve collaborating with cross-functional teams to deliver robust data solutions and efficient data pipelines that support our business needs. Scope of Work & Key Responsibilities: Design, develop, and maintain scalable and efficient data pipelines using Kafka to support large-scale data processing needs. Write SQL queries and manage MySQL databases to ensure data accuracy, integrity, and availability. Develop and maintain Linux scripts for automating data processing and ETL operations. Create and maintain data models that align with business requirements and optimize performance. Develop and maintain Kafka connectors using Java to integrate various data sources and ensure seamless data flow. Implement and manage data workflows using Airflow or other orchestration tools to automate data processing pipelines. Set up and manage CI/CD pipelines using Azure DevOps to ensure efficient code deployment and automated testing. Collaborate closely with cross-functional teams (Data Scientists, Analysts, and Business Stakeholders) to understand data requirements and deliver tailored solutions. Key Qualifications/Requirements: Bachelor's degree in Computer Science, Information Technology, or a relevant discipline. 3 to 5 years of hands-on development experience, with a strong understanding of the design, coding, and testing of information systems. Strong background in ETL development, particularly using Kafka, SQL, and MySQL. Proficiency in Linux scripting and data modeling to support efficient data processing and analysis. Experience with Airflow or other orchestration tools for managing complex workflows and data pipelines. Knowledge of Java programming for writing and maintaining Kafka connectors. Experience with Azure DevOps and CI/CD pipelines for streamlined deployment and automation. Strong understanding in the context of ETL/SSIR/SSIS products. Experience with integration technologies and DevOps is an added advantage. Demonstrated ability to independently design, develop, and implement high-quality software solutions. Familiarity with version control systems such as Azure DevOps and GIT for managing source code and collaboration. To apply, simply click the "Apply" button or send your updated profile to recruit@percept-solutions.com EA Licence No.:18S9405 / EA Reg. No.:R1330864 Percept Solutions is expanding and actively seeking talented individuals. We encourage applicants to follow Percept Solutions on LinkedIn at to stay informed about new opportunities and events. #J-18808-Ljbffr PERCEPT SOLUTIONS PTE. LTD.

Job Tags

Similar Jobs

Advocate Aurora Health

Staff RN, Operating Room, Full Time, Night Shift Job at Advocate Aurora Health

 ...Description Advocate Aurora Health is seeking a Registered Nurse (RN) OR - Operating Room for a nursing job in Green Bay, Wisconsin...  .... Our unit is staffed with registered nurses and surgical techs, but we also work very closely with OR EVS and anesthesia techs.... 

Style Netbox

Brand Promoter Job at Style Netbox

 ...strategy, we weave stories that captivate, designs that inspire, and strategies that propel your business forward.Job Title: Brand PromoterJob Description:A Brand Promoter is responsible for increasing brand awareness and driving customer engagement through strategic... 

Wellness Pet Company

Digital Marketing Intern Job at Wellness Pet Company

 ...feeding Wellness pet food. Were looking for a fun and dynamic Digital Marketing Intern to help us do just that. As the Digital Marketing...  ...analysis and social strategy discussions. This is an unpaid internship with the opportunity to earn college credit (based on your... 

ELCO Consulting

Chief of Staff Job at ELCO Consulting

 ...in the Bay Area, our client is a $30bn+ alternative investment management firm. JOB DESCRIPTION: Our client is hiring a Chief of Staff who will work directly with the firm's CEO and Executive Committee to help drive strategic initiatives, improve internal... 

Tata Consultancy Services

SAP Security / GRC Consultant Job at Tata Consultancy Services

 ...Job Description Job Title: SAP Security / GRC Consultant Must Have Technical/Functional Skills Experience in User administration & roles administration activities Experience with SAP role-based security concepts and their application/usage for S4 HANA....