Python Data Engineer
Tasks
- Build ETL and ELT processes
- Collaborate with cross-functional teams on requirements
- Design scalable high-performance applications
- Develop and maintain data pipelines
- Ensure data quality and reliability
- Implement near real time data streaming solutions
- Monitor and troubleshoot production systems
- Perform code reviews and architecture discussions
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Beam | BigQuery | CI/CD | Cloud Dataflow | Cloud PubSub | Cloud Run | Data Streaming | Databricks | Docker | ELT | ETL | GitLab | Google Cloud | Google Cloud PubSub | Infrastructure as Code | Kubernetes | Pandas | Python | SQL | Snowflake | Terraform | Test automation | Testing | Unit Testing | Version control | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Software Engineer, Google Cloud Storage INR 2500K-3500KBenchmarking | C++ | Connectors | Debugging | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India2h ago
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India6h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, Systems Infrastructure INR 2100K-4500KAPI Design | Apache Hadoop | Apache Kafka | Apache Spark | Big DataHealth and wellness programs | Time away from workExecutive-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, AI Infrastructure INR 1800K-5800KApache Kafka | C++ | Compliance | Data Modeling | Distributed SystemsHealth and wellness programs | Hybrid work option | Time away from workExecutive-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India6h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600667h ago
-
Technical Anchor INR 2500K-3000KASR | AWS | Adobe Experience | Adobe Experience Manager | Amazon LexAgile team collaboration | Off-hours support | On-call rotational support | Weekend support rotational basisSenior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Access Control | Ansible | Backup Management | Capacity Planning | DockerSenior-level Full TimeBengaluru, KA, India8h ago
-
Senior-level Full TimePune, India9h ago
-
Senior-level Full TimeBangalore, INDIA R13h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R13h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R13h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India13h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India13h ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 56001613h ago
-
Fraud Data Engineer, Assistant Vice President INR 600K-2000KAgile | Big Data | Confluence | Data Governance | Data QualityConfidential counseling | Employee Learning and Development | Paid parental leave | Paid time off | Telehealth accessExecutive-level Full TimeG-BLOCK, BANDRA-KURLA COMPLEX BANDRA EAST MUMBAI, …13h ago
-
Backend Engineer INR 2200K-3500KAKS | API documentation | Alerting | Asynchronous programming | AzureSenior-level Full TimeIND Bengaluru - Technology Campus, India13h ago
-
Senior-level Full TimeGurugram, India20h ago
-
Mid-level Full TimeGurugram, India20h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India21h ago
-
Mid-level Full TimeGurugram, India22h ago
-
FinOps Data Engineer INR 2520K-3380KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India22h ago
-
Senior Data Engineer INR 2520K-3380KAirflow | Apache Dataproc | CI/CD | Databricks | DataformDiversity & inclusion culture | Growth opportunitiesSenior-level Full TimeGurugram, India22h ago