Senior Data Engineer
Tasks
- Apply data modeling principles
- Conduct unit testing
- Design data workflows
- Develop PySpark jobs
- Develop data pipelines
- Import and export data
- Leverage Livy
- Manage Git branches
- Manage Hive tables
- Manage data movement
- Manage secrets
- Model data in Snowflake
- Operate Hadoop commands
- Perform file operations
- Review merge requests
- Use AWS CLI
- Utilize SSIS
- Work with Hive on Tez
Perks/Benefits
- International tech conference
- Reimbursement benefit
- Remote work
- Training opportunities
- Wellness program
Skills/Tech-stack
AWS | AWS Secrets | AWS Secrets Manager | Ansible Vault | Apache Airflow | Data Modeling | Git | GitLab | HDFS | Hadoop | Hive | Livy | Microsoft SQL | Microsoft SQL Server | PySpark | SQL Server | SSIS | Secrets Manager | Snowflake | Sqoop
Education
Roles
Related jobs
-
API Integration | Azure | CI/CD | Databricks | DevOpsContract position | Remote workSenior-level ContractRemote R7h ago
-
APIs | Data Analysis | Data Modeling | Data Visualization | JavaScriptFlexible working hours | Fully remote | Independent contractorMid-level Full TimePhilippines - Remote R20h ago
-
Senior Data Engineer EUR 50K-70KAWS S3 | Amazon Web Services | Apache Airflow | Apache Spark | Azure DatabricksAnnual team trip | Flexible working hours | Health insurance | Laptop and peripherals | Open holidaysSenior-level Full TimePorto, Porto District, Portugal - Remote R20h ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Capacity PlanningKnowledge transfer opportunities | Remote workSenior-level Full TimeEgypt - Remote R20h ago
-
Senior Data Engineer INR 600K-1500KAgile | Analysis Services | Archimate | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeIndia-Hyderabad-Remote R20h ago
-
Analysis Services | Azure | Azure Data | Azure Data Factory | Azure DevOps401k match | Flexible work environment | Medical, dental & vision coverage | PTO program | Professional developmentSenior-level Full TimeMinnesota R1d ago
-
Azure Data | Azure Data Factory | CI/CD | Data Factory | High Availability401k match | Career growth | Collaborative work culture | Dental insurance | Flexible work environmentMid-level Full TimeColorado R1d ago
-
Analysis Services | Azure | Azure Data | Azure Data Factory | CI/CD401 k company match | Collaborative work culture | Flexible work environment | Medical, dental, and vision coverage | PTO programSenior-level Full TimeFlorida R1d ago
-
Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory401k company match | Medical, dental, and vision coverage | PTO | Remote work | Tuition reimbursementMid-level Full TimeCalifornia R1d ago
-
Alerting | Azure DevOps | Bash | CI/CD | DBTFlexible working hours | Fully remote | Learning and developmentMid-level Full TimeBrazil - Remote R1d ago
-
DevOps Engineer USD 110K-135KAWS | AWS SSM | Ansible | Bash | CI/CD401k matching | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimeUnited States R1d ago
-
Senior Software Engineer (Golang/Python) USD 124K-203KAPIs | AWS | CI/CD | Distributed Systems | DockerFlexible collaboration | Remote workSenior-level Contract Full TimeLatin America R1d ago
-
Data Engineer USD 95K-178KAWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud development | Amazon QuickSightSenior-level Full TimeRemote R1d ago
-
Data Pipelines | Data indexing | Deep learning | Git | GitHub401k match | Asynchronous communication | Conference support | Flexible schedule | Health coverageSenior-level Full TimeWorldwide R1d ago
-
AWS | Algorithm Design | Amazon Web Services | Distributed Systems | Django100 percent remote | Equipment program | Flexible scheduling | Open time-off policy | Paid time offMid-level Full TimeRemote job R1d ago
-
Data Analytics Engineer II USD 77K-179KAmazon Redshift | BI tools | Cause analysis | Cohort Analysis | Columnar Data WarehouseChild and eldercare resources | Education assistance | Flexible work anywhere | Health insurance | Mental health resourcesMid-level Full TimeRemote, United States R1d ago
-
AI Engineer - Instrumentation USD 125K-225KAI Observability | Git | GitHub | Instrumentation | LLM401k plan | Medical/Dental/Vision | Mental Health and Wellness | Parental leave | Unlimited paid time offMid-level Full TimeRemote (United States) R2d ago
-
Enterprise Sales Engineer - West & Central USD 70K-95KAPIs | AWS | Agentic solutions | Cloud Networking | Cloud platformTravel opportunitiesMid-level Full TimeUSA Remote R2d ago
-
Data Engineer II USD 63K-114KETL | SQL | Snowflake401k | Flexible work arrangements | Health insurance | Paid time off | Stock purchase planMid-level Full TimeRemote-IL, United States R2d ago
-
Senior Data Engineer USD 87K-161KData Processing | Data pipeline | Data pipeline orchestration | ETL | Pipeline Orchestration401k | Flexible work schedule | Health insurance | Paid time off | Stock purchase plansSenior-level Full TimeRemote-WI, United States R2d ago
-
Senior Data Engineer USD 113K-180KApache Airflow | Automated testing | BigQuery | CI/CD | Cause analysisSenior-level Full TimeRemote within the US R2d ago
-
Enterprise Sales Engineer - East USD 88K-109KAPIs | AWS | Agentic AI | Azure | B2B SaaSTravel up to 50 percent | Workshops and BootcampsMid-level Full TimeUSA Remote R2d ago
-
Backend Engineer, Knowledge Graph (Rust) INR 3200K-4200KAPI Development | Alerting | Change Data Capture | ClickHouse | Data CaptureFlexible paid time off | Growth and development fund | Home office support | Parental leave | Team member resource groupsSenior-level Full TimeRemote, India R2d ago
-
Staff Backend Engineer, Knowledge Graph (Rust) INR 3384K-4590KCapacity Planning | ClickHouse | Data Modeling | Graph Data | Graph Data ModelingEquity compensation | Flexible paid time off | Growth and development fund | Home office support | Parental leaveSenior-level Full TimeRemote, India R2d ago
-
Staff Data Engineer USD 160K-185KApache Airflow | Apache Spark | Apache Superset | DBT | Data Modeling401k | AD and D insurance | Commuter benefits | Dental insurance | Employee assistance programSenior-level Full TimeRemote R2d ago