Java Spark Developer-Software Engineer II
Jersey City, New Jersey, United States
USD 80K-134K Mid-level Full Time
Tasks
- Design and build batch data pipelines
- Design and build real-time streaming data pipelines
- Implement and maintain fault tolerant ETL ELT workflows
- Integrate pipelines with relational databases and NoSQL stores
- Optimize and debug Apache Spark performance tuning
- Participate in agile ceremonies and code reviews
- Support deployment pipelines with CI/CD
- Use Git for version control
- Write SQL queries and integrate with databases
- Write and test Java code with SOLID principles
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | CI/CD | Concurrency | Distributed Systems | Docker | ELT | ETL | Event Driven | Event-driven architecture | Git | JUnit | Java | Java 8 | Kubernetes | Microservices | Object Oriented Concurrency | Object-Oriented | Object-oriented programming | RDD | SOLID | SQL | Scrum | Spark DataFrames | Spark Datasets | Spark SQL
Roles
Data Engineer | Developer | Engineer | Java | Java Developer | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Flexible spending account | Health insuranceEntry-level Full TimeWashington, DC, United States3h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data Quality15 percent travel | Hybrid remote onsite work | Public Trust support | Technical documentation updatesMid-level Full TimeFAIRFAX, VA, United States3h ago
-
Senior Data Engineer-JT0224 USD 120K-183K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R4h ago
-
AWS CloudFormation | AWS EC2 | AWS S3 | Amazon Elastic Kubernetes Service | Amazon Web ServicesCompany parties | Health insurance | Opportunity for advancementMid-level Full TimeSan Francisco, CA, US5h ago
-
AWS | Agentic AI | Azure | CI/CD | Cloud platform401k | Medical | Paid sick leaveMid-level ContractSouth San Francisco, United States6h ago
-
Data Modeling | Data Validation | Data profiling | Database Indexing | Dimensional ModelingMid-level ContractRichmond, United States7h ago
-
Apex | Automated testing | Azure DevOps | CI/CD | Claude CodeSenior-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 155K-306KAirflow | CI/CD | DBT | Data Modeling | DatabricksMentorship | Professional development | Travel for client workSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …8h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI | AWS | Agent Bricks | Airflow | Apache SparkSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …8h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship opportunities | Professional development | Travel reimbursementSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …8h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States8h ago
-
Azure Databricks Developer USD 126K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States8h ago
-
Acceptance Testing | Data Analysis | Data Quality | Data Visualization | Data reportingSenior-level Full TimeArlington/Rosslyn, Virginia, United States8h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship | Professional development | Travel opportunitiesSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …8h ago
-
Generative AI Engineer III - Federal Health USD 110K-218KArtificial Intelligence | Data Engineering | Data Pipelines | Data Validation | DockerMentorship opportunities | Professional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States8h ago
-
Data Engineer III (Secret Clearance Required) USD 107K-179KAWS | Anomaly Detection | Artificial Intelligence | Classification | ClusteringProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States8h ago
-
Data Management Engineer III USD 97K-162KAPI Integration | Agile | Apache Spark | Cloud Data | Cloud Data PlatformsProfessional development | Travel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …8h ago
-
Lead AI and Data Solutions Engineer II USD 134K-224KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud platformMentorship | Professional developmentSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …8h ago
-
Research Engineer - MSL FAIR Foundations USD 141K-208KAudio Processing | Benchmarking | Code review | Data Pipelines | Deep learningMid-level Full TimeMenlo Park, CA | Seattle, WA …9h ago
-
Performance & Capacity Engineer - Planning Optimization USD 147K-208KAI Models | Agent Orchestration | Artificial Intelligence | Bias Mitigation | Bin packingSenior-level Full TimeBellevue, WA | Menlo Park, CA …9h ago
-
Senior Forward Deployed Engineer, GenAI, YouTube USD 155K-225KAgent systems | C++ | CRM Integration | Developer Operations | Distributed SystemsSenior-level Full TimeSan Bruno, CA, USA; Chicago, IL, …9h ago
-
APIs | Access Management | C++ | Cloud infrastructure | Code reviewSenior-level Full TimeNew York, NY, USA; Chicago, IL, …9h ago
-
Staff Software Engineer, AI/ML Storage Infrastructure USD 207K-301KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Large-scaleSenior-level Full TimeSan Jose, CA, USA9h ago
-
Compute Technologies | Data Structures | Data structures algorithms | Distributed Systems | Hardware ArchitectureSenior-level Full TimeSunnyvale, CA, USA9h ago
-
C++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Generative AISenior-level Full TimeKirkland, WA, USA9h ago