Data Engineer (Python & PySpark)
Bangalore, Karnataka, India
INR 2800K-4000K (estimate) Senior-level Full Time
Tasks
- Architect and manage GCP based data solutions
- Architect data lake solutions
- Architect data warehouse models
- Automate manual data processes
- Build large scale data processing frameworks
- Design and develop ETL pipelines
- Implement snowflake schema
- Implement star schema
- Maintain ETL/ELT pipelines
- Optimize data delivery for scalability
- Orchestrate data workflows with Airflow
- Perform data warehousing design and modeling
- Translate data requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Kafka | Apache Spark | CCPA | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud PubSub | Cloud Storage | Data Governance | Data Privacy | Data Security | Docker | ELT | ETL | GDPR | Git | Google BigQuery | Google Cloud | Google Cloud Composer | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Functions | Google Cloud PubSub | Google Cloud Storage | Infrastructure as Code | Logging | MySQL | NoSQL | NumPy | Pandas | PostgreSQL | PySpark | Python | SQL | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Gen AI Engineer INR 2000K-4800KAI Governance | API Integration | AWS Bedrock | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeIN-TN-Chennai3h ago
-
Dot Net FSD AWS INR 1400K-1800K.Net Core | API Gateway | AWS CDK | AWS CodePipeline | AWS Well ArchitectedMid-level Full TimeIN-KA-Bangalore3h ago
-
Python Pyspark -Support Role INR 1500K-2000KApache Airflow | BMC | Informatica | PySpark | PythonHybrid work model | Night shift workEntry-level Full TimeIN-TN-Chennai R3h ago
-
Software Engineer INR 850K-1500KAPI Development | Artificial Intelligence | Automation | Azure | DebuggingMid-level Full TimeIN-KA-Bangalore3h ago
-
Software Engineer - Data engineer INR 2800K-4000KAWS | Azure | Data Governance | Data Lake | Data ModelingAccess to cutting-edge technologies | Collaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …3h ago
-
(#1556) Sr. Dotnet Engineer INR 1500K-3500KAPIs | AWS | Audit Logging | Authentication | AuthorizationSenior-level Full TimeAndhra Pradesh, Visakhapatnam, India3h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India4h ago
-
Associate Software Engineer INR 1500K-1910KAlerting | Angular | Azure | Azure Kubernetes | Azure Kubernetes ServiceEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India4h ago
-
AI Engineer – Retail/CPG Domain INR 1500K-2500KAWS | Azure | Cloud platform | Data Governance | Data ModelingMid-level Full TimeGurugram, Haryana, India4h ago
-
Gen AI Engineer INR 300K-390KAPI Development | Amazon Web Services | Azure | Cloud platform | EmbeddingsEntry-level Full TimeIndia4h ago
-
Software Engineer III - Python, Spark, AWS INR 1800K-3000KAWS EMR | Amazon CloudWatch | Amazon Redshift | Amazon Web Services | Apache HadoopSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Data Science – (Gen AI Developer) - Analyst INR 2000K-2600KAutogen | CI/CD | Data Analysis | Data Visualization | ETLEntry-level Full TimeBengaluru, Karnataka, India5h ago
-
Software Test Engineer- Must have- Python, Pyspark, SQL, Good to have-playwright or selenium, databricks or snowflake INR 1632K-2156KAPI Testing | Agile | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India5h ago
-
Analytics Engineer - SQL & Data Visualization INR 1500K-2040KAgile | Cloud Data | Cloud Data Warehouse | Data Lakes | Data ModelingMid-level Full TimeBengaluru, KA, India6h ago
-
Data Engineer (Python & PySpark) INR 1200K-2000KApache Airflow | Apache Spark | CI/CD | Cloud Composer | Cloud DataflowSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Software Engineering Professional INR 1500K-2500KAI orchestration | AIOps | APIs | AWS | Agent FrameworksMid-level Full TimeBengaluru, IN, 5601037h ago
-
Software Engineering Professional INR 1500K-2500KAI orchestration | AIOps | API Integration | AWS | Agent FrameworksMid-level Full TimeBengaluru, IN, 5601037h ago
-
DE&A - AIML - Data Science - Machine Learning INR 3000K-4000KApache Airflow | CSV | Cypher | Data Modeling | EmbeddingsSenior-level Full TimePune, Maharashtra, India7h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPIs | Agentic AI | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India7h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPI Design | Agent Frameworks | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India7h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPI Development | Azure | BERT | Bias Mitigation | Data PreprocessingMid-level Full TimeBangalore, Karnataka, India7h ago
-
Generative AI Lead INR 2475K-3465KAPIs | Chatbots | Cloud infrastructure | Conversational AI | Data LakesHybrid work | Reward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India7h ago
-
Assistant Manager-GDC INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeHyderabad, Telangana, India8h ago
-
Mid-level Full TimeHyderabad, Telangana, India8h ago
-
AWS | Airflow | Azure | CI/CD | DBTSenior-level Full TimeBengaluru, KA, India8h ago