Job Detail

Senior Performance Software Engineer, Deep Learning Libraries

Senior Performance Software Engineer, Deep Learning Libraries

NVIDIA

Santa Clara, CA

Job ID : 744a4f7142316970514a5a382b77375058413d3d

Job Description :

We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you!
As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs. The team delivers high-performance code to NVIDIA’s
cuDNN
,
cuBLAS
, and
TensorRT
libraries to accelerate deep learning models. The team is proud to play an integral part in enabling the breakthroughs in domains such as image classification, speech recognition, and natural language processing. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence!
We’re always striving for peak GPU efficiency on current and future-generation GPUs. To get a sense of the code we write, check out our
CUTLASS open-source project
showcasing performant matrix multiply on NVIDIA’s
Tensor Cores
with CUDA. This specific position primarily deals with code lower in the deep learning software stack, right down to the GPU HW.
What you'll be doing:
  • Writing highly tuned compute kernels, mostly in C++ CUDA, to perform core deep learning operations (e.g. matrix multiplies, convolutions, normalizations)
  • Following general software engineering best practices including support for regression testing and CI/CD flows
  • Collaborating with teams across NVIDIA:
    • CUDA compiler team on generating optimal assembly code
    • Deep learning training and inference performance teams on which layers require optimization
    • Hardware and architecture teams on the programming model for new deep learning hardware features
What we need to see:
  • Masters or PhD degree or equivalent experience in Computer Science, Computer Engineering, Applied Math, or related field
  • 6+ years of relevant industry experience
  • Demonstrated strong C++ programming and software design skills, including debugging, performance analysis, and test design
  • Experience with performance-oriented parallel programming, even if it’s not on GPUs (e.g. with OpenMP or pthreads)
  • Solid understanding of computer architecture and some experience with assembly programming
Ways to stand out from the crowd:
  • Tuning BLAS or deep learning library kernel code
  • CUDA/OpenCL GPU programming
  • Numerical methods and linear algebra
  • LLVM, TVM tensor expressions, or TensorFlow MLIR

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard working people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our Deep Learning Library team and help us build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.
The base salary range is $178,000 - $365,000. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
You will also be eligible for equity and
benefits
.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
#deeplearning

Company Details :

Name : NVIDIA

CEO : Jensen Huang

Headquarter : Santa Clara, CA

Revenue : $5 to $10 billion (USD)

Size : 10000+ Employees

Type : Company - Public

Primary Industry : Computer Hardware Development

Sector Name : Information Technology

Year Founded : 1993

rave-on-records.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, rave-on-records.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, rave-on-records.com is the ideal place to find your next job.

Details

: Santa Clara, CA

: 178000 - 365000 USD ANNUAL

: 183 days ago

Share Job :

Related Jobs

Sandusky, OH

55000 - 75000 USD ANNUAL

Full Time

_*Requirements*_ include a Bachelors degree in Social Work or Counseling with a valid professional license such as LSW or LPC. Social Work: 1 year (Required).

Data Specialist\Help Desk Support

American Fine Food Corp/Iwebgrocer

Hialeah, FL

48000 - 52000 USD ANNUAL

Full Time

Serve as the first point of contact for customers seeking technical assistance over the phone or email. IT support experience with hardware (desktop\\laptops),

Project Manager / Estimator

Bethlehem Construction

Wasco, CA

65000 - 95000 USD ANNUAL

Full Time

Must be a proactive engaged member of the team that looks at all aspects of design and construction, to ensure that all phases of the project go smoothly.

Software Engineer - (C++, JAVA,Python)

Johns Hopkins Applied Physics Laboratory (APL)

Laurel, MD

76543 - 113597 USD ANNUAL

Full Time

You will extend the capabilities of an advanced object-oriented Modeling and Simulation framework, including full life cycle support (requirements, design,

Project Manager - Pool Design

LOTHROP ASSOCIATES

White Plains, NY

75000 - 100000 USD ANNUAL

Full Time

Advanced study in a technical field such as architectural technology or other construction industry field. Hydraulic design for filtration, drain-down, backwash