Python, Pyspark, GCP Data Engineer
Bangalore, Karnataka, India
INR 2800K-4000K (estimate) Senior-level Full Time
Tasks
- Architect data solutions on GCP
- Automate manual processes
- Build large scale data processing frameworks
- Design ETL pipelines
- Develop ETL/ELT pipelines
- Implement data lake architectures
- Implement data warehouse models
- Maintain data pipelines
- Optimize data delivery for scalability
- Orchestrate data workflows with Airflow
- Process structured and unstructured data
- Translate data requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | Apache Spark SQL | BigQuery | CCPA | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud Storage | Cloud platform | Data Governance | Data Security | Docker | GDPR | Git | Google Cloud | Google Cloud Platform | Google Cloud Storage | Infrastructure as Code | Kafka | MySQL | NoSQL | PostgreSQL | Pub/Sub | PySpark | Python | SQL | Snowflake Schema | Spark SQL | Star Schema | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeKarnataka, Bengaluru, India4h ago
-
Mid-level Full TimeIN-AP-Hyderabad5h ago
-
Senior Data Management Professional - Data Rates INR 2800K-4000KAgile | Alerting | Anomaly Detection | CSV | Cause analysisSenior-level Full TimePune5h ago
-
Software Engineer - Data Engineer INR 2617K-3465KAWS | Azure | Data Engineering | Data Governance | Data LakesCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Embedded AI & Data Analytics Engineer INR 980K-1141KC++ | Classification | Data Modeling | Data Preprocessing | Data ValidationMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Agentic AI - Embedded System INR 2000K-2500KCI/CD | Distributed Systems | Edge AI | GPU Utilization | LangchainAccess to cutting edge technologies and tools | Collaborative work environment | In-office 5 days a week | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Agentic AI - Data analytics engineer INR 1000K-1820KC++ | Classification | Data Modeling | Data Pipelines | Data PreprocessingAccess to cutting-edge technologies | Collaborative work environment | Professional growth opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
BI Developer (Power BI + Sigma Computing) INR 1500K-2209KAccess Control | CI/CD | Data Governance | Data Model | Data ModelingSenior-level Full TimeGurugram, Haryana, India6h ago
-
Software Engineering INR 1500K-2000KApache Spark | Azure | Azure AKS | Azure Compute | Azure DataOn-call rotationMid-level Full TimeBengaluru, KA, IN6h ago
-
Software Engineering INR 1500K-2000KAI-enabled | AI-enabled development | Apache Spark | C# | C++Career growth opportunities | On-call rotationMid-level Full TimeBengaluru, KA, IN6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4500KAPI Integration | Agent systems | Cloud platform | CrewAI | Generative AISenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Software Engineer III, Full Stack, Cloud AI INR 2000K-3500KAgentic AI | Cloud Computing | Connectivity systems | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
API Testing | Apache JMeter | Automation Framework | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India7h ago
-
Azure Data Engineer Consultant INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunities | VIRTUAL interviewMid-level Full TimeBangalore, Karnataka, India7h ago
-
AI Engineer(Python, SQL, and GenAI frameworks ,LLM architecture, RAGs, embeddings, prompt tuning,agentic AI INR 2000K-4000KAWS | Agentic AI | Azure | Containerization | DockerSenior-level Full TimeGurugram, HR, India7h ago
-
Senior ETL Developer, Data Management INR 1500K-2209KAgile | Autosys | Control-M | Data Quality | ETLRotational on-callSenior-level Full TimeBangalore, India9h ago
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 5601039h ago
-
Software Engineer II INR 1500K-2000KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeBengaluru, KA, IN9h ago
-
Senior AI Engineer INR 2500K-4500KAI Search | API Development | AWS Bedrock | AWS SageMaker | Apache AirflowSenior-level Full TimeHyderabad, TS, India10h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India10h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN10h ago
-
Applied AI ML Associate INR 1000K-1500KAmazon Web Services | Apache Spark | Batch Processing | Caffe | Computer VisionMid-level Full TimeHyderabad, Telangana, India10h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India10h ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R11h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India12h ago