Data Engineering Specialist
Tasks
- Build NRT data pipelines
- Build batch data pipelines
- Build production data pipelines
- Create data product documentation and runbooks
- Define data quality rules and validation checks
- Design and build data products and pipelines
- Develop data product code templates
- Develop prototype SQL from business requests
- Investigate available data for data science use cases
- Maintain data platform infrastructure
- Perform operational maintenance of data products
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | BigQuery | CI/CD | Cloud platform | Clustering | Data Quality | Data Validation | Data pipeline | Docker | Execution Graph | GitLab | Google Cloud | Google Cloud Platform | Google Pubsub | Infrastructure as Code | Java | Materialized views | Partitioning | Python | SQL | SQL Optimization | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior Data Visualization INR 3000K-4000KAPIs | AWS | Agile | Azure | DAXCollaborative team environment | Continuous learning culture | Flexible work arrangement support | Hybrid work scheduleSenior-level Full TimeChennai, Tamil Nadu, India8h ago
-
AWS Bedrock | AWS CloudFormation | AWS CloudWatch | AWS Glue | AWS LambdaEqual opportunity inclusion and diversity | Professional development | Remote work opportunity | Workplace accommodationsSenior-level Full TimeIndia R12h ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAPI Auditing | Asynchronous programming | Authentication | Authorization | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesSenior-level Full TimePune, MH, IN, 41100615h ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAccuracy Metrics | Authentication | Authorization | CI/CD | CachingFlexible working | Inclusive work culture | Professional developmentSenior-level Full TimePune, MH, IN, 41100615h ago
-
AWS S3 | Amazon Web Services | Azure Data | Azure Data Engineering | BigQueryFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India15h ago
-
Amazon Web Services | Azure Data | Azure Data Engineering | BigQuery | Data ArchitectureFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
AWS | Amazon Web Services | Azure Data | Azure Data Engineering | BigQueryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
AWS | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web ServicesFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India15h ago
-
Solutions Engineer - Data Engineering (Hyderabad) INR 2000K-3000KAWS | Apache Airflow | Azure | CI/CD | Cloud platformHybrid work modelSenior-level Full TimeHyderabad R1d ago
-
Forward Deployed Engineer INR 2000K-3000KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percentSenior-level Full TimeRemote - India R1d ago
-
Data Specialist INR 1000K-2000KBatch scripting | DBAmp | Data Import Wizard | Data Integrity | Data LoaderMid-level Full TimeIND Bangalore C 601, India1d ago
-
Data Engineering Senior Manager - HIH - Evernorth INR 2500K-4000KAWS | Agile | Apache Airflow | Apache NiFi | Apache SparkSenior-level Full TimeHIH - Hyderabad, India1d ago
-
I&F Decision Sci Practitioner Specialist INR 2520K-4064KA/B | A/B Testing | Adobe Campaign | Adobe Experience | Adobe Experience PlatformSenior-level Full TimeMumbai, MDC2C, India1d ago
-
I&F Decision Sci Practitioner Specialist INR 2520K-4064KA/B | A/B Testing | Adobe Campaign | Adobe Experience | Adobe Experience PlatformSenior-level Full TimeBengaluru, BDC10A, India1d ago
-
Manager Data Engineering INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeHyderabad, India1d ago
-
Azure/AWS Architect-Banking - Manager INR 2000K-4000KAgile | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataSenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …1d ago
-
Executive-level Full TimeIN - HYDERABAD ORION, India1d ago
-
Specialist, Data Science INR 987K-1700KAutomation | Business Intelligence | Data Engineering | Data Modeling | Data VisualizationFlexible work arrangements | Hybrid work arrangementsMid-level Full TimeIND - Maharashtra - Pune (Wework), … R1d ago
-
Specialist, Data Stewardship INR 1500K-2168KBill of Materials | Data Governance | Data Management | Data Modeling | Data QualityHybrid work model | Onsite and Remote Flexibility | Visa sponsorshipSenior-level Full TimeIND - Telangana - Hyderabad (Hitec … R1d ago
-
Lead Digital Analytics & Adobe Customer Journey Specialist INR 2500K-4132KAdobe Analytics | Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Tags | Attribution ModelingSenior-level Full TimeMumbai Central Avenue, India1d ago
-
Manager - Data Engineering KDP INR 1500K-2700KAPIs | Agile | Amazon Web Services | Azure | Azure SynapseHybrid workMid-level Full TimeIN025 Embassy Manyata Business Park, India R1d ago
-
Manager Data Engineering INR 1000K-1700KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLMid-level Full TimeHyderabad, India1d ago
-
Executive-level Full TimeGurugram, Haryana, India1d ago
-
Vice President, Data Management & Quantitative Analysis INR 4111K-5199KAccess Control | Anomaly Detection | Business Continuity | Canonical Data | Canonical Data ModelsExecutive-level Full TimePune, MH, India2d ago
-
Senior-level Full TimePune, Maharashtra, India2d ago