The ideal candidate will have a strong background in data engineer, with extensive experience in MS SQL, SQL, SSIS, Python, Airbyte, Airflow, and DBT. This role will involve designing, developing, and maintaining our data infrastructure to support various business needs.
Key Responsibilities:
- Design, develop, and maintain robust data pipelines and ETL processes to ensure efficient data flow and integration across various systems.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions that meet business needs.
- Optimize and manage databases, ensuring high performance, availability, and scalability of data storage solutions.
- Implement and manage data workflows and orchestration using Airbyte and Airflow.
- Develop and maintain data transformation processes using DBT.
- Monitor and troubleshoot data pipeline issues to ensure data accuracy and integrity.
- Perform data analysis and generate reports to support business decision-making processes.
- Stay updated with the latest industry trends and best practices in data engineering and implement improvements as necessary.
Required Skills and Experience:
- MS SQL: 7+ years of experience in designing, implementing, and optimizing complex SQL queries and database solutions.
- SQL: 8+ years of experience with strong proficiency in SQL programming.
- SSIS: 7+ years of experience in developing and managing ETL processes using SQL Server Integration Services.
- Python: 5+ years of experience in scripting and automating data processes using Python.
- Airbyte: 3+ years of experience in data integration using Airbyte.
- Airflow: 3+ years of experience in workflow orchestration and management using Apache Airflow.
- DBT: 3+ years of experience in developing and managing data transformations using DBT (Data Build Tool).
Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Proven experience in data engineering with a focus on designing and managing large-scale data systems.
- Strong analytical and problem-solving skills with attention to detail.
- Excellent communication and collaboration skills.
- Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
Preferred Skills:
- Experience with cloud data platforms (e.g., AWS, Azure, GCP).
- Knowledge of data governance and best practices.
- Familiarity with additional data integration and analytics tools.
Apply now by sending your resume to vinita@dicetekindia.com.
Hiring Now: Fullstack Developer for TAMM-OS Platform DevelopmentDownload “Kalam AI” to generate social media Posts Easily.