Data Engineer
DGS India - Bengaluru - Manyata N1 Block
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Automate deployment and testing with Cloud Build and CICD
- Build scalable data pipelines on Google Cloud Platform
- Create event driven workflows with Pub Sub and Eventarc
- Develop ETL ELT pipelines with GCP services
- Ensure data security, governance, and compliance
- Integrate external APIs for data ingestion
- Optimize data processing and storage performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | BigQuery | CI/CD | Cloud Build | Cloud Composer | Cloud Functions | Cloud Run | Cloud Storage | Cloud platform | Data Modeling | Data Warehousing | Dataform | ELT | ETL | Event Driven | Event-driven architecture | Eventarc | Git | Google Cloud | Google Cloud Platform | Node.js | Object-Oriented | Object-oriented programming | Pub/Sub | Python | SQL
Education
Roles
Related jobs
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India1d ago
-
Developer II INR 2000K-5000KAWS EKS | Data Structures | Data Structures and Algorithms | Docker | FlaskSenior-level Full TimeBengaluru, KA, India1d ago
-
Data Engineer II INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeHyderabad, TG, IN1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago
-
AI QA & Evaluation Engineer INR 3584K-4580KAWS | Artificial Intelligence | Azure | Benchmarking | CI/CDFlexible schedule | Health insurance | Parental leave | Vacation days | Volunteer timeMid-level Full TimeBangalore, India1d ago
-
Senior Snowflake Engineer INR 2000K-4200KAPI Development | AWS | Apache Airflow | Automated testing | AzureCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeAll Cities, India R1d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
Associate Engineer-AI/ML INR 2165K-3000KAPI Integration | Amazon Web Services | Azure | C++ | CD pipelinesEmployee discounts | Training opportunities | Tuition reimbursement | Wellness benefitsMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Junior BI Developer/Data Engineer - India Home Base INR 300K-300KBig Data | Data Modeling | Data Pipelines | ETL | JavaFlexible remote work | Professional development opportunitiesEntry-level Full TimeBangalore, India1d ago
-
Access Control | Anomaly Detection | Audit Logging | CI/CD | ClassificationRemote working modelSenior-level Full TimeIndia1d ago
-
AI safety & Security controls, LLM Guardrails/Associate Director, Software Engineering Specialist INR 1400K-2400KAPI Development | Asynchronous processing | Audit trails | Cloud Computing | Content SafetyCareer development | Flexible working | Inclusive cultureMid-level Full TimePune, Maharashtra, India R1d ago
-
Databricks Data Engineer - Contract-to-Hire INR 1500K-3000KAWS | Apache Spark | Azure | Data Reconciliation | Data ValidationMedical insurance | Paid time off | Professional development trainingSenior-level Full TimePune, MH, India2d ago
-
Senior Databricks Data Engineer INR 1500K-3500KAWS | CI/CD | Databricks | Delta Lake | LakehouseMedical insurance | Paid time off | Performance incentives | Professional development trainingSenior-level Full TimePune, MH, India2d ago
-
Lead AI Specialist (Finance Operations) INR 3264K-5449KAccess Control | Agent Orchestration | Audit Logging | BigQuery | Change ManagementCollaborative culture | Growth opportunities | Work-life balance programsSenior-level Full TimeMumbai, MH, India2d ago
-
Senior-level Full TimeBengaluru, Karnataka, India R2d ago
-
Applied AI ML Associate INR 1400K-2400KAutomation | Data Quality | Data analytics | Data pipeline | DatabaseMid-level Full TimeBengaluru, Karnataka, India2d ago
-
Airflow Python Developer INR 1500K-2600KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Apache AirflowEntry-level Full TimeHyderabad, TS, India2d ago
-
Applied AI ML Associate INR 1400K-2400KCause analysis | Credit Risk | Credit risk modeling | Data Analysis | Data DriftMid-level Full TimeBengaluru, Karnataka, India2d ago
-
AES - DE - Generative AI Solution Architect INR 2500K-4800KAI Agents | Azure | Conversational AI | Copilot Studio | Language ModelsSenior-level Full TimePune, Maharashtra, India2d ago
-
Lead Assistant Manager INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Storage | Cloud platformSenior-level Full TimePune, Maharashtra, India2d ago
-
Mid-level Full TimeBangalore, Karnataka, India R2d ago
-
AI Architect / Sr. AI Engineer INR 2000K-5000KAnthropic Claude | CI/CD | Chroma | Django | Django RESTRemote workSenior-level Full TimePune R2d ago
-
Senior Software Engineer(AI) INR 2500K-4580KAPI Development | Access Control | Agent Builder | Alerts | Automated testingBirthday off | Flexible working hoursSenior-level Full TimeGurgaon2d ago
-
Data Engineer Consultant Senior INR 3000K-4000KAgile | Alerting | Auditability | Automated testing | AzureBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R2d ago