Senior Data Engineer
Position: Senior Data Engineer
Job Summary:
We are looking for an experienced GCP Data Engineer to join our team in Hyderabad. The successful candidate will be responsible for designing, developing, and maintaining data pipelines and architectures on the Google Cloud Platform (GCP). The ideal candidate should have a strong background in data engineering, data warehousing, and cloud computing.
Responsibilities:
Design and develop data pipelines on GCP using technologies such as BigQuery, Cloud Storage, Cloud Composer, Dataflow, Pub/Sub, and other GCP services.
Design and develop data architectures on GCP for data ingestion, transformation, storage, and analysis.
Develop ETL processes to move data from on-premise/cloud source systems to GCP.
Proficient in Python and SQL
Monitor and optimize data pipelines for performance and cost.
Develop and maintain data models for analytics and reporting.
Develop and maintain data security policies and procedures.
Troubleshoot data issues and provide technical support to other teams.
Requirements:
• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in data engineering and cloud computing.
• Proficiency in GCP services such as BigQuery, Cloud Storage, Dataflow, Pub/Sub, etc.
• Experience with scripting languages such as Python and SQL.
• Knowledge of data warehousing and ETL processes.
• Ability to work independently and as part of a team.
• Excellent problem-solving and communication skills.