Data Engineer Automation Controls
Irving, TX; Sunnyvale, CA; Sunnyvale, CA; Sunnyvale, CA; Dallas, TX; Portland, OR
A USD 110K-160K (estimate) Mid-level Full Time
Tasks
- Build data APIs and data delivery services
- Build data pipeline frameworks for real time delivery
- Collaborate with product owners and customers to deliver data products
- Continuously integrate and deploy code to cloud production
- Define and improve internal software architecture processes
- Design and deploy production data pipelines with Hadoop tools
- Design robust systems for long term maintenance
- Develop cloud based applications using modern technology stack
- Handle mutable data in Hadoop
- Implement machine learning with PySpark
- Leverage reusable code modules
- Support and enhance anomaly detection machine learning platform
- Transform analytical models into production solutions
- Troubleshoot JVM issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon S3 | Angular | Anomaly Detection | Apache Airflow | Apache Beam | Apache Kafka | Apache NiFi | Apache Spark | Avro | Cassandra | Continuous integration | Elasticsearch | Git | Google Cloud | HBase | HDFS | Hadoop | Hadoop YARN | Hive | JVM | Java | Jenkins | Machine Learning | MongoDB | Neo4j | NoSQL | Node.js | ORC | Parquet | PySpark | Python | React | SAS | SQL | Scala | Shell Scripting | TDD | Unit Testing | Version control
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
AWS | Agile | Confluence | Django | Docker401k match | Career development | Dental insurance | Health insurance | HolidaysSenior-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …1h ago
-
Agile | Ansible | Apache NiFi | Automation | Continuous Monitoring401k employer contribution | Career development and training | Holiday pay | Paid health dental and vision premiums | Paid time offSenior-level Full TimeLinthicum Heights, MD; Laurel, MD; Laurel, …1h ago
-
AWS | Agile | Confluence | Data Gathering | Django401k employer contribution | Career counseling | Education and training support | Employee referral bonuses | Flexible work-life balanceMid-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …1h ago
-
API | CSS | JavaScript | Language Model | Large Language Model401k matching | Career development | Employee referral bonuses | Health, dental, vision coverage | Paid HolidaysSenior-level Full TimeFort Meade, MD; Fort Meade, MD; …1h ago
-
Cloud Analytic Software Engineer USD 135K-182KAWS | Apache Spark | CI/CD | Cloud platform | Distributed Systems401k matching | Birthday day off | Career support | Employee and family events | Flexible work scheduleMid-level Full TimeTysons, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 100K-215KAWS | Azure | CI/CD | Docker | GCPBirthday day off | Employee referral program | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeSan Antonio, TX; Aurora, CO; Chantilly, …1h ago
-
Cloud Analytic Software Engineer USD 135K-190KAWS | Azure | CI/CD | Distributed Systems | DockerBirthday day off | Career support | Employee referral program | Flexible work schedule | Paid leaveMid-level Full TimeReston, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 135K-206KAWS | Apache Spark | CI/CD | Cloud platform | Distributed SystemsBirthday day off | Flexible work schedule | Paid leave | Paid training | Referral programMid-level Full TimeHonolulu, HI; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 135K-190KAWS | Azure | CI/CD | Cloud Cost Optimization | Cost OptimizationBirthday day off | Flexible work schedule | Paid leave | Paid training | Referral bonus programMid-level Full TimeChantilly, VA; Aurora, CO; Honolulu, HI; …1h ago
-
Cloud Analytic Software Engineer USD 135K-206KAWS | Azure | CI/CD | Cloud Cost Optimization | Cost Optimization401k matching | 401k profit sharing | AFLAC | Birthday day off | Cafeteria style benefitsMid-level Full TimeAurora, CO; Chantilly, VA; Honolulu, HI; …1h ago
-
Cloud Analytic Software Engineer USD 150K-235KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | Data StreamingBirthday day off | Employee Family Events | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeAnnapolis Junction, MD; Aurora, CO; Chantilly, …1h ago
-
Natural Language Processing (NLP) Specialist USD 100K-115KData Visualization | Deep learning | Information Retrieval | Language Processing | Machine LearningBirthday day off | Comprehensive health coverage | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …1h ago
-
ActiveMQ | Agile | Amazon Web Services | Apache Beam | Apache CassandraMid-level Full TimeSan Mateo, CA; Irving, TX; Sunnyvale, …2h ago
-
Senior-level Full TimeSan Bruno, CA; San Bruo, CA; …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
API | Amazon Web Services | Amazon Web Services (AWS) | Apache HDFS | Apache SparkRemote workMid-level Full TimeRemote, US; Sunnyvale, CA; Dallas, TX R2h ago
-
Adobe Analytics | Airflow | Apache Hive | Apache Spark | Data LineageSenior-level Full TimeSan Bruo, CA; San Bruno, CA; …2h ago
-
Airflow | C++ | Data Pipelines | Distributed Computing | ElasticsearchSenior-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R2h ago
-
Mid-level Full TimeAtlanta, GA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …2h ago
-
Mid-level Full TimeSunnyvale, Ca; San Bruno, CA; Dallas …2h ago