Senior Data Engineer
Tasks
- Automate and monitor data workflows
- Collaborate with architects to establish best practices
- Collaborate with cross-functional teams to deliver datasets
- Create modular dbt data models
- Design data ingestion pipelines
- Develop Python and SQL ingestion and transformation code
- Implement BigQuery partitioning and clustering
- Implement CI/CD workflows
- Implement data quality checks and testing
- Lead data integration pipeline development
- Maintain data workflow orchestration
- Maintain technical documentation
- Mentor junior engineers and conduct code reviews
- Optimize BigQuery queries
- Transform raw data into curated datasets
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | CI/CD | Cloud Composer | Cloud Dataflow | Clustering | DBT | Data Governance | Data Quality | Data Validation | Data Warehousing | Databricks | ELT | ETL | Fivetran | Git | Google BigQuery | Kanban | Partitioning | Pub/Sub | Python | Query Optimization | SQL | Scrum | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Developer | ETL Developer | Engineer | Senior Data Engineer | Senior ETL Developer
Related jobs
-
Senior-level Full TimeHyderabad, India7h ago
-
Staff Software Engineer, Looker, Cloud Data Analytics INR 2500K-4200KAI platforms | Artificial Intelligence | Data Storage | Distributed Computing | Enterprise SoftwareSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Embedded Developer - IOT Connectivity INR 1000K-1800KAWS IoT | AWS IoT Core | Automated testing | Azure IoT | Azure IoT HubFlexible hours | Health insurance | On-demand training | Paid volunteering leave | Parental supportMid-level Full TimeChennai, TN, IN, 60009710h ago
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN14h ago
-
Senior-level Full TimePune, Maharashtra, India18h ago
-
Senior-level Full TimePune, Maharashtra, India18h ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India19h ago
-
AI Model Training | AI model | Bash | Cloud platform | Data IngestionAsynchronous culture | Entrepreneurial team | Flexible management approach | Remote-friendlyMid-level Full TimeBangalore, India19h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial team | Friendly work environment | Opportunity for large impactMid-level Full TimeNoida, India19h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudEntrepreneurial team | Flexible, async culture | Mission driven product impact | Supportive hands off managementMid-level Full TimeMumbai, India19h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Friendly laid-back atmosphere | Hands-off managementMid-level Full TimeAhmedabad, India19h ago
-
Senior-level Full TimeHyderabad India - Block B19h ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore19h ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R19h ago
-
Spclst , Data Engineering INR 1163K-2558KAWS EMR | AWS Glue | AWS IAM | AWS Lake | AWS Lake FormationMid-level Full TimeIND - Telangana - Hyderabad (Hitec …23h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior Manager INR 2000K-5000KAWS | Agents SDK | Anthropic Claude | Anthropic Claude API | AuthenticationSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Mid-level Full TimeHaryana, India R1d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R1d ago
-
Associate - Analytics Solution INR 1000K-1500KAgile | Alteryx | Artificial Intelligence | Confluence | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Developer INR 346K-360KAWS | Agile | Amazon EventBridge | CI/CD | Cloud ComputingMedical benefits | Paid time off | Wellbeing benefits | Work-life balanceEntry-level Full TimeHyderabad, India1d ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Scientist - AI Engineering INR 3264K-5000KAWS | AWS Bedrock | Agentic AI | Anthropic Claude | Automated RegressionCareer growth | Company-sponsored certifications | Innovation time | Mentorship | SnacksSenior-level Full TimeHyderabad, TS, India1d ago
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R1d ago