Enterprise Data Engineer | Cloud Data Pipelines, GCP, Big Data, and Data Governance
Tasks
- Apply data governance, security, and compliance standards
- Automate data ingestion transformation and validation
- Build and maintain batch and real time data processing ecosystems
- Collaborate with stakeholders to define data workflow requirements
- Design scalable data pipelines for enterprise analytics
- Document data architecture pipeline design and operational procedures
- Implement data migration and schema design
- Monitor pipeline performance troubleshoot failures
- Perform data validation and reconciliation
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Hive | Apache Spark | BigQuery | Cloud Storage | Cloud platform | Dataflow | Google Cloud | Google Cloud Platform | Power BI | Python | SQL | Tableau | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API Security | Application Security | Automation | Bash | CI/CDMid-level ContractHyderabad, India3h ago
-
Pyspark Developer INR 800K-1500KData Modeling | Dimensional Modeling | PySpark | Relational databases | SQLMid-level Full TimeIN-TN-Chennai5h ago
-
AWS Data Engineer- Airflow INR 1500K-2400KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopSenior-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAWS | Airflow | Amazon SageMaker | Apache Airflow | Apache SparkAccess to cutting-edge technologies | Collaborative work environment | In office 5 days per week | Professional development | Training and education opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
MS Fabric / Azure Data Engineer ( 5- 7 yrs ) - Immediate Joiners INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data ArchitectureImmediate JoinersSenior-level Full TimeBengaluru, KA, India5h ago
-
Staff Software Engineer, Analytics INR 2520K-4000KAlgorithms | Analysis and Design | Big Data | C++ | Data IngestionSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1500K-2500KAPIs | Agent systems | Cloud platform | Data Pipelines | Google CloudMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-2500KAPIs | Agent systems | Cloud platform | CrewAI | Data EngineeringMid-level Full TimeMumbai, Maharashtra, India; Gurgaon, Haryana, India6h ago
-
None Full TimeNoida, Uttar Pradesh, India6h ago
-
None Full TimeNoida, Uttar Pradesh, India6h ago
-
None Full TimeIndia7h ago
-
AI Software Engineer III - Platform INR 2000K-4000KAPI Gateway | APIs | AWS EC2 | AWS Lambda | Amazon APISenior-level Full TimeHyderabad, Telangana, India8h ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeIndia9h ago
-
Mid-level Full TimeBengaluru, Karnataka, India10h ago
-
Associate Process Manager INR 800K-1500KAWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India10h ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R11h ago
-
Data Engineer INR 1753K-2250KAPI | Agile | Azure Automation | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeChennai, Tamil Nadu, India12h ago
-
API | Batch Processing | Data Compliance | Data Governance | Data ModelingContinuous learning | Flexible work hours | Health and wellness support | Inclusive work culture | Paid time offSenior-level Full TimeIndia12h ago
-
AI Senior Software Engineer INR 2000K-4000KAI Search | AI gateway | AI gateway patterns | API Design | AWS BedrockSenior-level Full TimeBengaluru, India12h ago
-
Senior System Administrator II [Storage Engineer] INR 1000K-1890KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru12h ago
-
Sr.Research Engineer - Applied AI/ML INR 2000K-4170KAPI Design | Algorithms | Apache Spark | Conversational AI | Data AnalysisSenior-level Full TimeGurugram, India13h ago
-
Application Engineer (AI Automation) INR 2500K-4500KApex | Data Modeling | Java | JavaScript | MilvusCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India15h ago
-
Machine Learning Engineer INR 1400K-2000KApache Spark | Azure | Classification | Cloud platform | ClusteringMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Mid-level Full TimeBengaluru, Karnataka, India17h ago