Senior Data Engineer

Firehouse Technology
14 days ago
tie
0 Applied
Expires on: Oct 17 2023
tie
featured

Ref.No 00003302

Description
  • Bachelor’s degree in computer science, Statistics, Math or a related field
  • At least 3+ years of relevant data engineering experience
  • Strong knowledge in Data Warehouse, Data Modelling including Big Data Technologies.
  • Advanced level programming skills in coding language (Python, Scala/PySpark)
  • Familiarity with Docker, Kubernetes, Message/ Storage Queues, Data Lakes

·

Experience with stream-processing systems (e.g., Spark Streaming), big data querying tools (e.g., Pig, Hive, Spark).

  • Experience in working with cloud service providers (Azure, AWS, GCP)
  • Experience in helping teams create robust data system architectures
  • Excellent communication and interpersonal skills to collaborate with internal and external stakeholders.
  • Passionate drive to solve real-world problems with AI delivering tangible business value through data pipelines and deployments.
  • Fluency in spoken and written English
Responsibilities
  • Has expertise in implementing complex big data pipelines, Kubernetes deployments of spark application.
  • Lead teams of 2-3 junior data engineers
  • Is able to communicate complex technical concepts to both technical and non technical audience
  • Contribute to knowledge building and sharing by researching best practices, documenting solutions and continuously iterating on new ways to solve problems
  • Provide robust solutions and decisions using your expertise in the data engineering domain.
  • Design and build high-performance, secure, and scalable data solutions following best practices.
  • Work closely with Head of Data and fellow team members to frame scalability and optimizations of the deployments.
  • Work closely with Architect on end-to-end technical design, methodology, development quality, deployment and management of the pipelines developed by the team.
  • Mentor junior members of the team, being a steady and guiding hand on project work.
  • Knack for helping an organization build advanced cloud-based solutions and contribute to proposals, POCs
  • Be a team player.
  • Possess a positive attitude and "go the extra mile".
Skills
Python
Azure
AWS
Data Warehouse
Data Modelling
Industry Sector