Lead Software Engineer - Event Streaming
Fremont, CA 
Share
Posted 1 day ago
Job Description
Lead Software Engineer - Event Streaming
Job Locations US
Job ID 2024-4662 Name Linked Remote: `US Country United States
Overview

DDN Storage is seeking great candidates to join our dynamic team of passionate customer-enabling technologists!

This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial services, autonomous cars, Government, academia, research and manufacturing.

"DDN's A3I solutions are transforming the landscape of AI infrastructure." - IDC

"The real differentiator is DDN. I never hesitate to recommend DDN. DDN is the de facto name for AI Storage in high performance environments" - ~ Marc Hamilton VP, Solutions Architecture & Engineering | NVIDIA

DDN Storage is the global leader in AI and multi-cloud data management at scale. Our cutting-edge storage and data management solutions are designed to accelerate AI workloads, enabling organizations to extract maximum value from their data. With a proven track record of performance, reliability, and scalability, DDN Storage empowers businesses to tackle the most challenging AI and data-intensive workloads with confidence.

Our success is driven by our unwavering commitment to innovation, customer-centricity, and a team of passionate professionals who bring their expertise and dedication to every project. This is a chance to make a significant impact at a company that is shaping the future of AI and data management.

Our commitment to innovation, customer success, and market leadership makes this an exciting and rewarding role for a driven professional looking to make a lasting impact in the world of AI and data storage.

Job Description

We are looking for a Lead Software Engineer for our RED Storage engineering team who will design, build, and deliver components of RED software storage solution:

    Design and implement lightweight publisher/subscriber event streaming broker architecture, integrating with complex highly resilient underlying distributed storage.
  • Drive design discussions, build prototypes and contribute to deliver high quality products.
  • Conduct code reviews and improve scalability, reliability and performance of RED solutions.
  • Collaborate with your teammates and integrate a group of passionate developers in an outcome-oriented environment.

Qualifications:

  • Prior experience with architecture and implementation of AI-based rules engines to facilitate data movement and transformation.
  • Experience with architecture and implementation of lightweight pub/sub event streaming technologies (ex. Apache Kafka, Mosquitto)
  • Knowledge of distributed file system solutions, parallel file system solutions or network file system is important.
  • Knowledge of various traditional data movement technologies including asynchronous replication, synchronous replication, and tiering
  • Experience in developing and debugging at system level C/C++, particularly for Linux/UNIX computing environments.
  • Excellent hands-on software development experience of 10+ years on scale-out and high availability storage solutions
  • NVM storage technology and/or distributed key-value storage systems are highly desired.
  • BS/MS/Ph.D in Computer Science, Computer Engineering, Statistics, Mathematics or equivalent degree/experience.
  • Attention to detail and commitment to high quality deliverables.
  • Strong team player with good communication skills and should be self-starter.
  • Excellent time management skills, with the ability to independently prioritize, multitask, and work under deadlines in a fast-paced environment.

The ideal candidate has knowledge of and experience in several of the following subjects:

  • Common Hierarchical Storage Management techniques including tiering as well as efficient data movement techniques from edge to core to cloud.
  • Parallel file system solutions (ex. Lustre, GPFS) or distributed file systems (ex. NFS)
  • Low-latency, high-bandwidth High-Performance Computing (HPC) networks
  • NVME and NVMEoF storage technology
  • Linux kernel internals
  • Memory mapped IO (mmap), event-driven and lock-free programming concepts
  • Distributed key-value storage systems (memcached)
DDN Core Characteristics

DDN has a very strong orientation towards these 4 characteristics and any successful employee will demonstrate these capabilities:

Self-Starter - Takes independent action to identify and solve problems. Seeks out relevant information needed to make decisions. Gets involved with new initiatives.

Success/Achievement Orientation - Delivers quality results consistently. Targets, achieves (or exceeds) measurable results. Sets challenging goals, focuses on critical priorities, and is accountable.

Problem Solving - Recognizes problems and responds with a systematic assessment that identifies and addresses cause of issue. Practical, realistic, and resourceful.

Innovative - Builds and improves key business processes that enhance the effectiveness of DDN. Generates new ideas, challenges the status quo, and solves problems creatively.

DataDirect Networks, Inc. is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity, gender expression, transgender, sex stereotyping, sexual orientation, national origin, disability, protected Veteran Status, or any other characteristic protected by applicable federal, state, or local law.

 

Job Summary
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Required Education
Doctorate
Required Experience
10+ years
Email this Job to Yourself or a Friend
Indicates required fields