Data Engineer
Tasks
- Build ETL/ELT pipelines
- Build Looker BI data models
- Design data pipelines
- Develop BigQuery data warehouse
- Implement data partitioning clustering
- Implement data quality checks
- Manage CI/CD workflows
- Monitor and troubleshoot data infrastructure
- Optimize BigQuery performance
- Write Python data processing code
- Write SQL transformations
Perks/Benefits
Skills/Tech-stack
Airflow | CI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platform | Clustering | DBT | Data Modeling | Data Quality | Data Warehousing | Dataflow | Dataform | Docker | ELT | ETL | Fivetran | Git | Google BigQuery | Google Cloud | Google Cloud Platform | Infrastructure as Code | Kubernetes | LookML | Looker | Materialized views | Partitioning | Power BI | Pub/Sub | Python | Query Optimization | SQL | Tableau | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Partner Engineer, Generative AI INR 2500K-4500KAWS | Azure | Bias Mitigation | C++ | Conversational AISenior-level Full TimeBangalore, India | Mumbai, India2h ago
-
Senior-level Full TimeMumbai, Maharashtra, India4h ago
-
Associate Process Manager INR 2000K-2500KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systemsMid-level Full TimePune, Maharashtra, India6h ago
-
Mid-level Full TimeBengaluru, IN, 5601036h ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India6h ago
-
Senior_AI_developer INR 3000K-4500KAI pipeline | API Orchestration | ASPICE | Agent behavior | CI/CDSenior-level Full Timebangalore, India6h ago
-
API | Agile | Apache Spark | Big Data | CI/CDHybrid workSenior-level Full TimeBengaluru, INDIA, India7h ago
-
Technologist, Software Development Engineering : 14 years + C, C++/Python Server / Storage/Firmware Architecture /Linux Kernel INR 2486K-5076KAPI Design | BIOS/UEFI | Block layer | Board Firmware | C#Senior-level Full TimeBengaluru, KA, India7h ago
-
Senior Data Engineer, Payments INR 2940K-4170KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache HBaseSenior-level Full TimeBangalore, India8h ago
-
Software Engineer 2 - AI/ML- Bangalore INR 1294K-2157KAWS | AWS Bedrock | Azure | Git | Google CloudMid-level Full TimeIndia8h ago
-
Cloud Data Platform Engineer-Senior INR 2000K-2400KAWS RDS | Azure SQL | Backup and Recovery | Bash | CI/CDSenior-level Full TimeBengaluru, KA, IN, 56001614h ago
-
Sr. AI/Data Scientist INR 2500K-5000KAWS | Agent workflows | Automated testing | CI/CD | ContainersSenior-level Full TimeBangalore, Karnataka, IN India, 56008714h ago
-
EY - GDS Consulting - AIA - Gen AI - Manager INR 1800K-2500KAWS | Agent Orchestration | Azure | Caching | Cost OptimizationMentorship | Professional developmentMid-level Full TimeBengaluru, KA, IN, 56001614h ago
-
Data Platform Engineer - Assistant Vice President INR 1500K-6000KAWS | Apache Flink | Database APIs | Docker | Event DrivenExecutive-level Full TimeTOWER B, EON FREE ZONE II, …14h ago
-
ALB | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsEmployee Mental Wellness Assistance Program | Employee investment plan | Medical coverage | Paid time off | Relocation assistanceEntry-level Full TimeBangalore, Karnataka, India14h ago
-
Data Science AI Pod Member INR 2500K-3100KAgile | Data Pipelines | Deep learning | Feature Engineering | Generative AIOnsite work 5 days per week | Relocation assistanceEntry-level Full TimeChennai, Tamil Nadu, India14h ago
-
Assistant Vice President -Senior Bigdata Engineer INR 1500K-2000KApache Kafka | Apache Spark | Couchbase | Data Analysis | Data GovernanceSenior-level Full TimeTOWER B, EON FREE ZONE II, …14h ago
-
Assistant Vice President -Senior Java -Spark -Bigdata Engineer INR 2040K-2800KApache Kafka | Apache Spark | Couchbase | Data Warehousing | DockerSenior-level Full TimeTOWER B, EON FREE ZONE II, …14h ago
-
Tech Lead - AI Platform & Consumer Systems INR 1800K-4800KAPIs | Agent Frameworks | Agent systems | Databases | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
AI auditability | Accelerate | Access Control | Attention Mechanisms | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Data Analytics and AI Solutions Lead INR 3150K-4500KAmazon Redshift | Business Intelligence | Dashboards | Data Engineering | Data GovernanceSenior-level Full TimeIndia - Hyderabad14h ago
-
EG-100 - Information Technology / Data Architecture INR 2486K-4144KAPI Development | API Gateway | AWS API | AWS API Gateway | AWS DataZoneSenior-level Full TimeHyderabad, India14h ago
-
Senior Data Engineer INR 2500K-3500KAgile | Apache Airflow | CI/CD | Cloud platform | Data EngineeringCross-functional collaboration | Flexible working options | Hybrid working | Job shadowing | Leadership development programsSenior-level Full TimeHyderabad Knowledge City (LTC), India14h ago
-
Sr Analyst, Data Engineering INR 1500K-2040KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeIND07, India14h ago
-
Senior Data Engineer - GBS IND INR 1800K-2800KAutoscaling | Backups | Disaster Recovery | Federation | HadoopSenior-level Full TimeHyderabad, India14h ago