Applications Development Sr Programmer Analyst - Python Spark
TRIL INFO PARK, CAMBRIDGE TOWER, India
INR 2000K-3200K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT workflows
- Conduct feasibility studies
- Contribute to data architecture
- Design and build data pipelines
- Develop application systems
- Ensure data quality integrity governance
- Estimate time and cost
- Implement data transformations
- Implement logging monitoring debugging
- Implement security measures
- Integrate data sources
- Manage CI/CD pipelines
- Optimize Spark jobs
- Plan IT activities
- Review code and mentor developers
- Support data migration to Spark
- Support production and performance tuning
- Validate and aggregate data
- Write unit tests
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Avro | Azure Data | Azure Data Factory | Batch Processing | CI/CD | CSV | Cloud Storage | Data Factory | Data Governance | Data Integrity | Data Quality | Data pipeline | Debugging | Delta Lake | Distributed Computing | ELT | ETL | Feature Engineering | Git | HDFS | Hive | JSON | Kafka | Linux | Logging | Message Queues | Monitoring | NoSQL | ORC | Oozie | Parquet | PySpark | Python | RDBMS | SQL | Spark Structured Streaming | Streaming processing | Structured Streaming | Unit Testing
Education
Related jobs
-
AI Engineer / AI Developer INR 1800K-3300KAI Agents | Alerting | Amazon SQS | Async Programming | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R9h ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE) R9h ago
-
AI Engineer – Python & Snowflake INR 1800K-2700KAPI Development | AWS | Airflow | Azure | Data ModelingMid-level Full TimeHyderabad, Hyderabad, IN9h ago
-
Senior AI Engineer (Full-Stack) (Remote) INR 2500K-5000KAWS | Active Directory | Anthropic | ArcGIS REST | ArcGIS REST APIClient facing ownership | Remote workSenior-level Full TimeMaharashtra, Pune, India R9h ago
-
Senior Database Engineer - #3180 (Remote) INR 1500K-2700KAWS CDK | AWS IAM | AWS KMS | Amazon Aurora | Amazon CloudFormationSenior-level Full TimeChennai, India R9h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India10h ago
-
Entry-level Full TimeCoimbatore, India10h ago
-
Senior-level Full TimeHyderabad, India10h ago
-
Entry-level Full TimeCoimbatore, India10h ago
-
Senior-level Full TimeIN-HR-Gurgaon11h ago
-
Senior-level Full TimeIN-KA-Bangalore11h ago
-
Senior Engineer - Embedded QA INR 1500K-2094KAgile | CI/CD | Continuous Deployment | Continuous integration | Data Driven TestingSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 411013 R11h ago
-
Senior-level Full TimeBengaluru, Karnataka, India12h ago
-
Staff Software Engineer, Play Games Discovery INR 2500K-4500KData Pipelines | Data Processing | Data Structures | Data Structures and Algorithms | Distributed ComputingSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Software Engineer (AI,Java/Python) INR 2475K-3500KAPI Development | AWS | Agent Frameworks | Agent systems | Amazon SQSFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Wellness supportSenior-level Full TimeHyderabad, India13h ago
-
Access Control | Autogen | CI/CD | Chroma | Continuous MonitoringEntry-level Full TimeHyderabad, Telangana, India13h ago
-
Senior-level Full TimeIndia13h ago
-
Data Integration Lead INR 1500K-2500KCICD | Control-M | IBM InfoSphere | IBM Infosphere DataStage | InfoSphere-DataStageClient facing communication | Production support experienceSenior-level Full TimeIndia13h ago
-
DevOps Track Sr.Engineer INR 2229K-4000KAPI Gateway | APM | AWS CloudWatch | AWS Systems Manager | AWS systemsSenior-level Full TimeIndia13h ago
-
Database Track Sr.Engineer INR 2000K-3000KData Architecture | Database Schemas | Database performance | Database performance tuning | Disaster RecoverySenior-level Full TimeIndia13h ago
-
Big Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Factory | Data Factory | Data IngestionSenior-level Full TimeIndia13h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia13h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Search | AI Services | Anthropic | Azure AI | Azure AI ServicesExecutive-level Full TimeIndia13h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia13h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia13h ago