GCP Data Engineer
Tasks
- Apply schema inference and data lineage
- Build Bronze layer for raw data storage
- Create automated workflows with Cloud Composer
- Design real-time ingestion pipelines
- Design storage partitioning strategies
- Develop streaming data capture with Dataflow
- Ensure healthcare data compliance
- Establish data landing zone controls
- Implement batch loading with Dataproc
- Manage data catalog and metadata
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Beam | Apache Kafka | Avro | CDC patterns | Cloud Composer | Cloud Storage | Confluent Platform | Cost Optimization | Data Versioning | Dataflow | Dataproc | FHIR | GCP | HIPAA | HL7 | Healthcare Compliance | IAM Security | JSON | Java | Kafka Streams | Lifecycle Management | Log Aggregation | Observability | Parquet | Pub/Sub | Python
Education
N/A
Roles
Related jobs
-
Lead Consultant - RAG Engineer INR 2535K-4225KAWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud NativeContinuous learning opportunities | Hands-on experience | MentorshipSenior-level Full TimeIndia-Gurugram20h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestBudget for education | Budget for personal growth | Budget for wellness | Local team meetups | Remote workSenior-level Full TimeNoida, India20h ago
-
Python Developer INR 2500K-3000KAWS | Debugging | Django | Event Driven | Event-driven architectureMid-level Full TimeIN-KA-Bangalore20h ago
-
Databrick Developer INR 2000K-2040KAgile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeIN-TN-Chennai20h ago
-
GEN AI developer INR 2500K-3000KAPI Integration | Anthropic Claude | Context Management | Crew AI | FastAPIMid-level Full TimeIN-KA-Bangalore20h ago
-
Senior-level Full TimeIN-AP-Hyderabad20h ago
-
Azure | Csharp | Data Ingestion | Data cleaning | Machine LearningCommunity forums | Laptop provided | Medical insurance | Mentorship | No weekend workSenior-level Full TimeIndia R20h ago
-
002ASR - React Native Engineer INR 1800K-2500KAWS | Adobe XD | CI/CD | Context API | ExpoContract employment | Remote work | UK shiftSenior-level ContractTamil Nadu, Coimbatore, India21h ago
-
Software Engineer - Product (Technical Leadership) INR 2829K-5000KAI | Data Analysis | Java | JavaScript | Machine LearningSenior-level Full TimeBangalore, India22h ago
-
Senior-level Full TimeBangalore, India | Mumbai, India22h ago
-
Consultant- Data Support INR 316K-500KAlteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks24/7 rotation | Customer service focusEntry-level Full TimeBangalore, Karnataka, India22h ago
-
Embedded C++ developer with RTOS skills INR 1000K-2000KBitbucket | C plus plus | CAN | CANopen | Change ManagementSenior-level Full Timebengaluru, India22h ago
-
Embedded C++ developer with Yocto skills INR 2000K-3200KBitbucket | C plus plus | CAN | CANopen | CI/CDSenior-level Full Timebengaluru, India22h ago
-
Microsoft Fabric Data Engineer INR 1800K-2040KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactorySenior-level Full TimeThane, Maharashtra, India22h ago
-
Data Science – (Gen AI Developer) - Associate INR 2000K-2400KAutogen | CI/CD | Data Analysis | Data Visualization | ETLSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India22h ago
-
Lead Data Engineer INR 1200K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryUK shift workSenior-level Full TimeBengaluru, KA, India1d ago
-
India:Service Line:Consultant:Systems Support Engineer INR 1400K-1800KAWS | Agile | Azure | Azure Pipelines | CI/CD24x7 rotationMid-level Full TimeMumbai, India1d ago
-
Mid-level Full TimeMumbai, Maharashtra, India1d ago
-
Azure Data Engineer Consultant INR 1600K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksDiscounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India1d ago
-
Data Quality Engineer-Azure Data Platform Testing INR 1500K-2000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeGurugram, Haryana, India1d ago
-
Senior Machine Learning Engineer INR 3500K-5000KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work | Learning and development programs | Mentorship | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer (Job Location: Mahadevapura) INR 3384K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentoring | Remote work optionsSenior-level Full TimeBangalore, India R1d ago
-
Data Engineer Ii INR 1200K-2000KAWS | Agile | Batch Processing | DBT | Data LakesExtensive training initiatives | Group insurance | Growth opportunities | Hospitalization insurance | Meal vouchersMid-level Full TimeBangalore, KA, IN, 5600761d ago
-
Mid-level Full TimeGurgaon, Haryana, India1d ago