Data Engineer ID50062
Blacksburg, United States
USD 147K-166K (estimate) Senior-level Full Time
Tasks
- Build ingestion workflows from third party APIs
- Consult on requirements and translate into technical roadmaps
- Design and build scalable data lakehouses
- Design and build scalable data lakes
- Design and build scalable data warehouses
- Implement ETL and ELT pipelines at scale
- Optimize file formats for data retrieval
- Orchestrate data pipelines
- Provision and manage cloud and on prem infrastructure with Terraform
- Support machine learning initiatives and advanced analytics
Perks/Benefits
- Education budget
- Fitness budget
- Flexible schedule
- Mentorship
- Office options
- Personalized growth roadmaps
- Remote work options
- Team activity budget
- Techtalks
Skills/Tech-stack
AWS | AWS SageMaker | Apache Airflow | Apache Spark | Avro | DuckDB | Elasticsearch | GCP | Jupyter | Lakehouse | Medallion Architecture | NoSQL | ORC | OpenSearch | Pandas | Parquet | Polars | PySpark | Python | SQL | Scala | Snowflake | Terraform | Third Party | Third-party APIs
Education
Roles
Related jobs
-
Data Engineer ID50062 USD 147K-166KAWS | Advanced SQL | Advanced SQL optimization | Airflow | AvroFlextime | Mentorship | Remote work options | TechtalksSenior-level Full TimeTampa, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Advanced SQL | Advanced SQL optimization | Apache AirflowFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote workSenior-level Full TimeTallahassee, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Amazon S3 | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeHouston, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeWest Palm Beach, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAPI Integration | Airflow | Amazon Web Services | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBaltimore, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Columnar StorageFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMiami, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeRichmond, United States2h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeOrlando, United States2h ago
-
A/B | A/B Testing | B testing | ChatGPT | ClaudeMid-level ContractHarrisburg, United States3h ago
-
Analyst, Benchmark Analytics USD 90K-110KData Science | Database systems | Financial Market Benchmarks | Financial market | Fixed Income401k matching | Accident protection | Healthcare coverage | Life insurance | Long-term disabilityMid-level Full TimeNew York, NY, United States3h ago
-
Agile | Automation | Data Quality | Data pipeline | Distributed Systems401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York3h ago
-
Revenue Operations Analytics Engineer Momence USD 125K-145KAWS | DBT | Data Modeling | Data Quality | Data ValidationExtra days off for volunteering | Flexible working arrangements | Free mental health support | Paid parental leaveEntry-level Full TimeDenver, CO, United States3h ago
-
AI tool integration | Automated testing | Bias Mitigation | CSS | Ethical AISenior-level Full TimeMenlo Park, CA4h ago
-
Software Engineer, Google Cloud Storage USD 147K-211KAccess Control | Block Storage | C++ | Chaos Engineering | Cloud FunctionsMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA4h ago
-
Staff Software Engineer, DevIntel Data Warehouse USD 207K-300KC++ | Dashboards | Data Analysis | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA4h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KAccess Control | As-a-Service | Block Storage | C++ | Chaos TestingSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA4h ago
-
Algorithms | C++ | Cloud platform | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Software Engineer, AI/ML, Creative Intelligence USD 147K-211KA/B | A/B Testing | B testing | C++ | Deep learningMid-level Full TimeMountain View, CA, USA4h ago
-
BigQuery | Cloud platform | Computer Vision | Data Processing | Data WarehousingSenior-level Full TimeKirkland, WA, USA4h ago
-
Full Stack AI Software Engineer USD 216K-283KAPI Development | AWS | Classification | Cloud platform | Data PipelinesAdoption leave | Commuter benefits | Dental insurance | Disability insurance | ESPPExecutive-level Full TimeSan Mateo, CA, United States10h ago
-
Aerospace software | C++ | Camera | EKF | Factor GraphsDental insurance | Equity | Health insurance | Paid time off | Vision insuranceSenior-level Full TimeHawthorne, CA11h ago