Software Engineer I - Data Operations Engineer
Lalitpur, Nepal
TechKraft Inc.
About the role:
We are looking for a Data Engineer to join our team. If you are interested in being a guiding voice on a critical feature delivery team, this position is for you. The team is responsible for implementing and configuring the data pipelines that ingest and do the ETL and process diverse sources of data. This includes building large batch processing and streaming systems. You will be exposed to every area of our platform and AWS services (Serverless – Lambda, EMR – Hadoop/Spark, EKS – Kubernetes, etc.) but even more so, help drive the evolution of the product and team as we continue to grow rapidly. We believe heavily in architecture evolution, and you will bring your experience on best practices as we build out new components of the platform.
Work you’ll do / Responsibilities:
- Effort estimation of Data Operations activities/tasks
- Understand the file layout of various input file formats and perform parser validation
- Automation of DataOperations worflows in PySpark/SQL
- Writing SQLs for User Acceptance Criteria
- User Acceptance testing (UAT) support
- Perform day to day activities using Agile methodologies
- Onsite – offshore coordination on day-to-day activities
What you bring to the Team:
- Bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering)
- Knowledge of data management fundamentals and data storage principles
- Strong experience with hands-on data analysis of large data sets.
- Advanced SQL skills
- Big Data Testing, ETL Testing experience
- Python scripting experience
- Strong experience of Healthcare Payer Data testing
- Experience with AWS services like Redshift, S3, Athena and DataBricks.
Bonus Points:
- Experience with other Cloud Data Warehouses (Big Query, Snowflake)
- Hands on experience of API testing
- ETL testing automation experience
Equal Opportunity Employer:
As a mission-led technology company that is helping to drive better healthcare outcomes, the company believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. We are dedicated to building diverse teams, and as such provide equal employment opportunities to all employees and applicants for employment. As well as prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture Athena AWS Big Data BigQuery Computer Science Data analysis Databricks Data management DataOps Data pipelines Engineering ETL Hadoop Kubernetes Lambda Pipelines PySpark Python Redshift Snowflake Spark SQL Statistics Streaming Testing
Perks/benefits: Career development Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.