Software Engineer - Spark, scala, Python, SQL, Databricks
Tasks
- Build and optimize data pipelines and analytical solutions
- Collaborate with cross-functional agile teams
- Design develop and maintain PostgreSQL databases
- Design scalable data solutions using Apache Spark and Scala on Azure Databricks
- Develop and maintain Databricks notebooks jobs and workflows
- Develop production-grade Python and Scala code for data processing
- Implement code quality and performance tuning best practices
- Integrate Azure services using ADLS and Key Vault
- Use Git for version control and configuration management
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Automated testing | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Key Vault | Big Data | Big data processing | CI/CD | Data Lake Storage | Data Modeling | Data Processing | DevOps | Distributed Systems | Git | Key Vault | PostgreSQL | Python | SQL | Scala
Education
Roles
Related jobs
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India4h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 2500K-3500KAlgorithms | Design Patterns | Java | Machine Learning | Object-OrientedSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Associate Engineer - Agentic AI Developer INR 2000K-3000KAgent systems | Azure | CI/CD | Docker | FastAPIMid-level Full TimeMumbai, MH, India6h ago
-
Azure | CSV | ETL | Python | SQLSenior-level Full TimeBangalore, India7h ago
-
Senior Data Engineer INR 1500K-2500KApache Airflow | Apache Hive | Apache Oozie | Apache Spark | BigQueryAdditional voluntary benefits | Disability programs | Flexible working hours | Life insurance | Private medical careSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India12h ago
-
GenAI Support Lead - Manager INR 2000K-3465KAI Agents | AI Governance | API Testing | Bias detection | CI/CDEmployee networks | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Principal QA Engineer – GenAI Testing - Manager INR 1500K-2500KAI Governance | Adversarial Testing | Artificial Intelligence | BDD | Bias detectionFlexible work/life support | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Gherkin | GitEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Generative AI Quality Engineer - Senior Associate INR 1500K-2600KArtificial Intelligence | BDD | CI/CD | Fiddler | GherkinEmployee networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India12h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Mid-level Full TimeMumbai, India12h ago
-
Automation and AI Solutions Lead INR 2500K-3500KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | CI/CDFlexible vacation | Headspace access | Hybrid work | Mental health days | Retirement savingsSenior-level Full TimeIndia, Bengaluru, Karnataka R12h ago
-
Senior Lead Data Engineer (Snowflake, DBT, Python)- 8 to 13 Years- Chennai & Bangalore INR 2755K-4000KApache Airflow | DBT | Data Modeling | Data Pipelines | ELTCollaboration and respect | Flexible work environment | International work environment | Personal development opportunities | Wellbeing benefitsSenior-level Full TimeIND CHNN 32 A&B 3FL STE …12h ago
-
Entry-level Full TimeBengaluru18h ago
-
Snowflake + Aws + dbt + sql Deputy Manager- DE INR 1500K-2000KAgile | CI/CD | DBT | Data Modeling | SQLAnnual appraisal | Free HMO coverage | Paid leaves | Safe work environment | Skills training opportunitiesMid-level Full TimeBengaluru, KA, India20h ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Senior Platform Engineer (AI Integration) INR 2800K-4000KAWS | Auto Scaling | Bash | CI/CD | Cloud loggingHealth insurance | Personal accident insurance | Term life insurance | Work on-call rotationSenior-level Full TimePune, Maharashtra, India (Hybrid) R1d ago
-
Senior Data Quality Engineer INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaSenior-level Full TimeBangalore, KA, India1d ago
-
Lead AI Solution Developer INR 2000K-3307KAPI chaining | AWS Bedrock | Access Control | Agentic Automation | Auditability401k matching | Community service initiatives | Dental insurance | Employee engagement activities | Flexible spending accountSenior-level Full TimeBengaluru, KA, India1d ago
-
Data Engineer INR 720K-1820KAWS | Access Control | Azure | CI/CD | ClusteringAnnual vacations and holidays | Day care assistance program | Medical plans | Relocation program | Retirement benefitsMid-level Full TimeBangalore, KA, IN, 5600481d ago
-
Software Engineering SMTS- Tableau INR 2829K-4500KAWS | Agile | Azure | C# | C++Adoption Assistance | Coaching | Fertility benefits | Hybrid work model | On-demand trainingSenior-level Full TimeIndia - Bangalore1d ago
-
Data Analytics and AI Solutions Lead INR 3150K-4500KAI Automation | Dashboards | Data Engineering | Data Governance | Data ModelingSenior-level Full TimeIndia - Hyderabad1d ago
-
Senior Engineer - Data Engineer INR 2000K-2800KAWS | Airflow | CI/CD | CloudWatch | CodeBuildHybrid workSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …1d ago
-
Principal Specialist- Data Science Customer Programs INR 2400K-4000KAWS | Apache Spark | Azure | Data Architecture | Data GovernanceHybrid workSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago