Data Engineer Specialist - VOIS
Tasks
- Build ETL and ELT pipelines
- Configure Cloud Data Fusion pipelines with error handling and orchestration
- Design data pipelines on GCP using Databricks
- Develop PySpark jobs
- Implement data quality and observability
- Maintain monitoring and performance tuning
- Optimize pipeline performance reliability and cost
- Use CI CD practices with Git based promotion
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Data | Cloud Data Fusion | Cloud Dataproc | Cloud Storage | Cloud platform | Data Fusion | Data Quality | Databricks | Delta Lake | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Observability | PubSub | PySpark | Python | SQL | Unity Catalog
Related jobs
-
Lead Consultant - RAG Engineer INR 2535K-4225KAWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud NativeContinuous learning opportunities | Hands-on experience | MentorshipSenior-level Full TimeIndia-Gurugram17h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestBudget for education | Budget for personal growth | Budget for wellness | Local team meetups | Remote workSenior-level Full TimeNoida, India17h ago
-
Python Developer INR 2500K-3000KAWS | Debugging | Django | Event Driven | Event-driven architectureMid-level Full TimeIN-KA-Bangalore18h ago
-
Senior-level Full TimeIN-TN-Chennai18h ago
-
Databrick Developer INR 2000K-2040KAgile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeIN-TN-Chennai18h ago
-
GEN AI developer INR 2500K-3000KAPI Integration | Anthropic Claude | Context Management | Crew AI | FastAPIMid-level Full TimeIN-KA-Bangalore18h ago
-
Senior-level Full TimeIN-AP-Hyderabad18h ago
-
Senior-level Full TimeGurugram, Haryana, India18h ago
-
002ASR - React Native Engineer INR 1800K-2500KAWS | Adobe XD | CI/CD | Context API | ExpoContract employment | Remote work | UK shiftSenior-level ContractTamil Nadu, Coimbatore, India19h ago
-
Software Engineer - Product (Technical Leadership) INR 2829K-5000KAI | Data Analysis | Java | JavaScript | Machine LearningSenior-level Full TimeBangalore, India19h ago
-
Senior-level Full TimeBangalore, India | Mumbai, India19h ago
-
Data Analytics Solutions Specialist INR 1500K-1500KBusiness Intelligence | Dashboard Development | Data Validation | Data Visualization | JavaCareer growth and developmentMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Consultant- Data Support INR 316K-500KAlteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks24/7 rotation | Customer service focusEntry-level Full TimeBangalore, Karnataka, India19h ago
-
Embedded C++ developer with RTOS skills INR 1000K-2000KBitbucket | C plus plus | CAN | CANopen | Change ManagementSenior-level Full Timebengaluru, India19h ago
-
Embedded C++ developer with Yocto skills INR 2000K-3200KBitbucket | C plus plus | CAN | CANopen | CI/CDSenior-level Full Timebengaluru, India19h ago
-
Microsoft Fabric Data Engineer INR 1800K-2040KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactorySenior-level Full TimeThane, Maharashtra, India20h ago
-
Data Science – (Gen AI Developer) - Associate INR 2000K-2400KAutogen | CI/CD | Data Analysis | Data Visualization | ETLSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India20h ago
-
Analytics Solutions - Analyst INR 1022K-1452KAlteryx | Data Architecture | Data Modeling | Data Transformation | HiveMid-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior-level Full TimeBangalore, Karnataka, India21h ago
-
Lead Data Engineer INR 1200K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryUK shift workSenior-level Full TimeBengaluru, KA, India21h ago
-
Mid-level Full TimeMumbai, Maharashtra, India22h ago
-
Engineering-L2-Bengaluru-Vice President-Data Governance INR 1500K-4500KAI | Auditing | Automation | Controls Testing | Data AccuracyExecutive-level Full TimeBengaluru, Karnataka, India22h ago
-
Engineering-L2-Bengaluru-Associate-Data Governance INR 1500K-2000KAI | Automation | Data Accuracy | Data Analysis | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India22h ago
-
Engineering-L2-Bengaluru-Associate-Data Governance INR 1500K-2000KAI | Analytics | Automation | Data Analysis | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India23h ago