Lead Cloud Data Engineer

9 days ago
1 Applied
Expires on: Jun 04 2024

Ref.No 00004559

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 8+ years of relevant experience in Cloud Data Management, preferably in a lead capacity.
  • Expertise in Big Data Technologies: Demonstrated proficiency in Kafka, ElasticSearch, Logstash, and Kibana, ensuring optimal utilization within the data ecosystem.
  • Data Engineering and ETL/EDW Design: Extensive experience in Data Engineering methodologies, ETL/EDW design processes, and best practices.
  • Data Modeling: Proficiency in data modeling techniques to create efficient and scalable data structures.
  • Change Data Capture (CDC) Process: Experience in CDC processes, preferably with knowledge in tools like Debezium or other CDC tools.
  • On-Prem to Cloud Migration: Specialized knowledge in facilitating seamless migration of data from on-premises to cloud environments.
  • Hortonworks Data Platform/Cloudera Stacks: Experience with Hortonworks Data Platform or Cloudera Distribution stacks for effective data management.
  • AWS Development: Proficiency in AWS services such as RDS with Postgres SQL, DynamoDB, Data Pipeline, Database Migration, and AWS Kafka.
  • Code Management and CI/CD: Experience in configuring Git/Bitbucket/SVN for code management and a solid understanding of Continuous Integration/Continuous Deployment (CI/CD) practices.
  • Source-to-Target Mapping and Data Modeling: Hands-on experience in source-to-target mapping and adherence to data modeling best practices.
  • REST API Processes: Knowledge and practical experience in REST API processes, including PUT/GET methods.
  • Agile Methodology: Experience working in Agile environments, utilizing SCRUM or Kanban methodologies.
  • Domain Experience: Exposure to the Insurance domain is advantageous.
  • Client Handling: Experience in managing client interactions is beneficial.
  • Additional Skills (Advantageous): Experience in Python and Spark will be considered a plus.
  • SQL Proficiency: Hands-on experience in SQL coding, optimization, and fine-tuning for database operations.


Industry Sector