Associate Architect - Data (AWS + AtScale)
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build governed data access using semantic layer
- Build real time pipelines with AWS Kinesis
- Create semantic models and metric definitions
- Design AWS data lake architecture
- Design AWS data warehouse
- Develop ETL using AWS Glue
- Develop Python and PySpark data processing jobs
- Develop metadata frameworks
- Enforce row and column level security
- Implement data lakes and lakehouse
- Implement governance and cataloging with AWS Lake Formation
- Integrate and migrate data with AWS DMS
- Integrate semantic layer with BI tools
- Manage operational databases with Amazon RDS
- Optimize Redshift schema and query performance
- Orchestrate pipelines with AWS Step Functions
- Process data with AWS Lambda
- Query data with Amazon Athena
- Run distributed workloads on Amazon EMR
- Write complex SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS CloudTrail | AWS DMS | AWS Glue | AWS IAM | AWS KMS | AWS Kinesis | AWS Lake Formation | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Aggregate awareness | Amazon Athena | Amazon Aurora | Amazon CloudWatch | Amazon DynamoDB | Amazon EMR | Amazon MWAA | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | AtScale | BI tools | CI/CD | Caching | Column-Level Security | Data Governance | Data Lake | Data Lakehouse | Data Modeling | Data mesh | Data virtualization | DocumentDB | ETL | Indexing | Lake Formation | MongoDB | MySQL | Partitioning | PostgreSQL | PySpark | Python | Query Optimization | Query Pushdown | Row Level Security | SQL | Schema Design | Secrets Manager | Semantic Modeling | Step Functions | Terraform
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India2h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-4500KAPIs | Batch Processing | BigQuery | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Gurgaon, Haryana, India2h ago
-
Business Intelligence Engineer INR 1400K-1700KAgile | Jira | SQL | SnowflakeFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R3h ago
-
Mid-level Full TimeBengaluru, KA, IN3h ago
-
Manager INR 300K-370KApache Airflow | Data Modeling | Data Pipeline Architecture | Data Processing | Data pipelineSenior-level Full TimeIndia4h ago
-
Senior Big Data Engineer INR 800K-1500KAmazon EMR | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache FlinkSenior-level Full TimeChennai, India4h ago
-
Software Engineer II INR 950K-1250KApache Kafka | Apache Spark | BFS | Batch Processing | Cloud ComputingMid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN4h ago
-
Senior-level Full TimeWhitefield, Bangalore, India5h ago
-
Senior-level Full TimeWhitefield, Bangalore, India5h ago
-
Senior-level Full TimeWhitefield, Bangalore, India5h ago
-
Senior-level Full TimeWhitefield, Bangalore, India5h ago
-
Senior-level Full TimeWhitefield, Bangalore, India5h ago
-
Azure Data Engineer INR 1000K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIndia6h ago
-
Data Engineer Senior Consultant INR 2000K-2146KAzure Data | Azure Data Factory | CI/CD | DAX | Data FactoryOn-call support | Shift workSenior-level Full TimeHyderabad, TG, IN6h ago
-
Scientist 5, Data Science (12+ years experience . Generative AI, interpretable ML, Statistics) INR 2500K-5000KA/B | A/B Testing | APIs | AWS | Agnostic RAGSenior-level Full TimeBengaluru, KA, India6h ago
-
Associate Staff Engineer, Generative AI INR 2500K-3199KAI Foundry | AI Search | AWS Bedrock | Agentic AI | Azure AIMid-level Full TimeChennai, India6h ago
-
Senior-level Full TimeBANGALORE, KA, IN, 5600487h ago
-
Staff - Back End Developer INR 2040K-3500KAPI Design | AWS | Asynchronous processing | Azure | CachingSenior-level Full TimeBANGALORE, KA, IN, 5600487h ago
-
Sr.EM Data Engineering INR 2800K-3500KAPI Development | AWS | Automated testing | CI/CD | Data ProcessingDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalSenior-level Full TimeIndia (Remote-First) R7h ago
-
Mid-level Full TimePune, Maharashtra, India8h ago
-
Sr. Staff Software Engineer, Machine Learning INR 2500K-4500KC++ | Data Pipelines | Deep learning | Explainability | FairnessHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India9h ago
-
Lead Software Engineer INR 3375K-4590KAWS | Distributed Systems | GitHub Copilot | Java | LLMContinuous learning | Cross-functional projects | Online learning campus | Training coursesSenior-level Full TimeMumbai, India9h ago
-
Software Engineer II INR 3050K-4590KAWS | Agile | Algorithms | Cloud Computing | Code reviewCareer growth | Collaborative team culture | Flexible work arrangements | Inclusive workplace | Learning opportunitiesSenior-level Full TimeMumbai, India9h ago
-
AI/ML Engineer II INR 950K-1250KAWS | Azure | Containerization | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R10h ago
-
AI/ML Engineer II INR 950K-1250KAmazon Web Services | Azure | Cloud platform | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R10h ago