Categories
Tag: kubernetes
What’s New in IntelliJ IDEA Ultimate 2023.3
Releases The Ultimate edition of IntelliJ IDEA goes beyond the basics, offering a comprehensive suite of features, including in-depth profiling capabilities, database tools, built-in support for many web and enterprise frameworks, and more. In this latest v2023.3 release, we’ve rolled out a suite of new features to enhance your coding…
CorGTA Inc. hiring Machine Learning Engineer (Vertex AI) in Canada
*****This company is a Data Consultancy & Solution Provider with high-profile clients that works with Data Scientists, Data Engineers, and Software Engineers to solve any & all business problems. (Data & Analytics Strategy, Data Governance, Data Warehousing, Predictive Analytics, & Cloud BI Services) Machine Learning Engineer (Vertex AI) Job Title:…
Deploying OpenAPI Helm Chart on AWS EKS
To deploy the OpenAPI Helm chart on AWS Elastic Kubernetes Service (EKS), we’ll follow these steps: Create an EKS cluster. Configure Kubeconfig to interact with your cluster. Use the Pulumi Kubernetes provider to deploy the OpenAPI Helm chart using kubernetes.helm.v3.Chart. Before we begin, ensure you have the following prerequisites in…
Skip failed “mount” for notebook volumes – Zero to JupyterHub on Kubernetes
seb31 January 19, 2024, 2:17pm 1 Hello, We configured jupyterhub so that we mount NAS shares in our users’ notebooks, great.Some are NFS mounts, other are kerberized ones, and we also have some case where we use SMB CSI and mount shares based on k8s secrets containing user/password The problem…
kubernetes – Setting up JupyterHub on K8s: Can I forward the user to different node pool (cpu vs. gpu)
I am currently investigating whether it’s worth to setup Jupyter on K8s. I came across this website: z2jh.jupyter.org/en/latest/index.html. One of the questions I have is forwarding a user to appropriate node pool. I will have 2. One is with CPU running and one with GPU active. I don’t want all…
Help getting the right blob mount permissions – Zero to JupyterHub on Kubernetes
Hello,I have a cluster running on AKS after following the guideI am trying to mount a static Azure Blob Storage (bring your own storage) shared by all of the singleuser pods (I have a custom spawner that mounts subdirectories of the blob). I have setup an SC, PV, and PVC…
Software Developer (m/w/d), Austria – SaluteMyJob
EMBO is a not-for-profit organization that promotes excellence in life sciences in Europe and beyond. We fund talented researchers at all stages of their careers, stimulate scientific exchanges through high-quality academic publishing, conferences and lectures, and help build a research environment where scientists can achieve their best work. Our international…
University of North Carolina at Chapel Hill hiring Bioinformatics Data Scientist in North Carolina, United States
Posting InformationPosting Information Department Renaissance Computing Inst-637100 Career Area Information Technology Posting Open Date 09/14/2023 Application Deadline 01/02/2024 Open Until Filled No Position Type Permanent Staff (EHRA NF) Working Title Bioinformatics Data Scientist Appointment Type EHRA Non-Faculty Position Number 20059390, 20061324 Vacancy ID NF0007337 Full Time/Part Time Full-Time Permanent FTE…
ML Pipelines on GCP with Vertex AI
20 Nov 2023 by dzlab Vertex AI Pipelines are a platform for building and running machine learning workflows on Google Cloud Platform. They allow the orchestration of machine learning tasks using pre-built or custom components, and leverage the serverless and scalable infrastructure of Vertex AI. Vertex AI Pipelines is based…
The year in Google Cloud: Top news of 2023
In the world of technology and cloud computing, the news comes fast and furious. Blink and you’ll miss it. As we wind down the final days of 2023, here’s a look at the top stories of the year that we published on the Google Cloud blog — the product launches,…
Cloudflare Revolutionizes AI Deployment with Cutting-Edge MLOps Platform
Summary: Cloudflare’s innovative MLOps platform is transforming the landscape of Artificial Intelligence (AI) deployment. With a focus on collaboration, scalability, and optimized workflows, Cloudflare is leading the way in delivering robust ML training methodologies at an unparalleled scale. Cloudflare’s MLOps strategy encompasses the implementation of best practices in collaboration with…
Ray on Vertex AI: Let’s get it started | by Ivan Nardini | Google Cloud – Community | Dec, 2023
Figure 1 — Image from author At Next 2023, Google Cloud announced Ray on Vertex AI, a managed service that provides scalability for AI and Python applications using Ray.As a Vertex AI developer, you may be wondering: As a Vertex AI developer, you may be wondering: What is Ray? Why…
Upcoming Google Event Highlights & Insights
The recently held Google Cloud Next event in San Francisco was a major highlight of the year, featuring keynotes from Google’s top management, 161 announcements, and thousands of attendees. The event emphasized the importance of artificial intelligence (AI) in driving innovation across various industries and highlighted the latest developments in…
Jupyterhub z2jh ingress not working – Zero to JupyterHub on Kubernetes
bpfrd December 15, 2023, 6:54pm 1 Hi, I deployed z2jh on a single-node microk8s cluster on a server and it is supposed to be used in production. The problem is ingress address is missing. here is some details: # config.yaml ingress part ingress: annotations: kubernetes.io/tls-acme: “true” enabled: true hosts: -…
Senior R Studio Administrator – Remote – EPAM Systems
If you are looking for a high-impact Senior R Studio Administrator with a global leader in digital transformation, EPAM is the perfect next step in your career! As an EPAMer, you’ll have the opportunity to work with a supportive team, on a variety of interesting projects for some of the…
With Gemini Pro, Google Vies for Top Spot in GenAI Race
Having delivered its Gemini Pro multimodal AI model, Google showed that it’s nowhere near an also-ran in the AI race; it’s a potential top dog. Google has made its Gemini Pro AI model available to developers to begin building applications using the company’s newly announced large language model (LLM). Last…
Installing JupyterHub via Stackable Demo on K8s | by Alex McLintock | Dec, 2023
docs.stackable.tech/home/stable/demos/jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data So, this is an article in an ongoing series where I investigate the deployment tools of Stackable.tech This firm supplies supported versions of many open source data engineering tools to easily build data platforms on Kubernetes (k8s) clusters. These can be on your own premises, in a data centre,…
URI encoding? “.” character in the LDAP authentication – Zero to JupyterHub on Kubernetes
Hello, members. When the user(jupyter.user contains . character) login, Expect behavior: create home jupyter.user Actual behavior: create home jupyter-2euser %2E means ., in the URI encode.So, I suspect Z2JH encodes some characters.Does anyone know how to fix it? hub: config: Authenticator: enable_auth_state: true JupyterHub: authenticator_class: ldapauthenticator.LDAPAuthenticator LDAPAuthenticator: server_address: ldapserver lookup_dn:…
Some thoughts on Z2JH “Trash” – feel like I’m close but need some nudge(s) in the right direction? – Zero to JupyterHub on Kubernetes
I’d like to provide a file ‘security net’ for my users using Z2JH. My solution would be to utilize a share file system, mounted to each pod. extraVolumes: – name: trash persistentVolumeClaim: claimName: trash-pvc extraVolumeMounts: – name: trash mountPath: # Would this be ~/.local/share/Trash? /.Trash? subPath: trash I can toggle…
Software-Enabled Flash Announces Release of Software Development Kit
SEF announces release of Software Development Kit (SDK) donated by Kioxia SAN FRANCISCO, Dec. 11, 2023 /PRNewswire/ — The Linux Foundation is excited to announce a significant milestone in the realm of storage technology with the release of the Software Enabled Flash(™) (SEF) Software Development Kit (SDK). The SDK is donated…
Is there a way to create a REST API token with user’s OAuth token through REST API – Zero to JupyterHub on Kubernetes
Hi Jovyans, Jupyterhub version: 1.4.2 Authenticator: GenericOAuthenticator Issue: Need to call REST API(/users//server) to start user server, this requires an user’s API token. I’ve been blocked with ‘how to create an API token for an user through a REST API’ I’m able to manually create an user’s API token on…
yatendra jha | Analytics Vidhya
Participated in DataHour: Deep Dive into Kubernetes and Concepts of Containerization Participated in DataHour: Basics of Big Data File Formats Participated in DataHour: Google Cloud Vertex AI Platform Participated in DataHour: Apache Airflow – An Open Source Workflow Manager Participated in DataHour: Data Availability Through Data Lake in Large Organization…
Sharing some data with each users. (creating symblink or bind mount) – Zero to JupyterHub on Kubernetes
Hello members. 1. Overview This configuration mounts NFS volumes on the following mount points. /home/jovyan /home/shared IIUC, A Z2JH user doesn’t access /home/shared by default.So, I want to create a symlink or bind mount point like /home/jovyan/shared.Does anyone know what configuration file I can set bind mount or symlink? singleuser:…
ServerApp.iopub_data_rate_limit – Zero to JupyterHub on Kubernetes
escader December 6, 2023, 12:43pm 1 Hello. I deployed jupyterhub using helm chart v.2.0.0 and jupyterhub version 3.4.6. I get an error when doing a task. !!! I tried to set the jupyter notebook parameter –NotebookApp.iopub_data_rate_limit=100000000 when building docker, but I get ‘iopub_data_rate_limit’ has moved from NotebookApp to ServerApp. I…
Planning to use Kubernetes of a system in which already has SLURM configured – General Discussions
Dear All,Good morningWe have 4 nodes which is already installed with Ubuntu 22.04 , SLURM and we are not usinging much of HPC on this system.In order to make use of the existing hardware we plan to install Kubernetes on the same machine which has SLURM installed , my concern…
JupyterJupyterhub and Enterprise Gateway error starting kernel – JupyterHub
OrenZ1 December 5, 2023, 5:56pm 1 Hello!I am using jupyter enterprise gateway 3.2.2 with jupyter hub 2.1.1 and JupyterLab 3.6.3.I am having a weird problem when starting a kernel on a kubernetes cluster. The images I use for the kernels are heavy, and so it takes long to pull them…
Snowflake Joins the PyTorch Foundation as a General Member
by Team PyTorch The PyTorch Foundation, a neutral home for the deep learning community to collaborate on the open source PyTorch framework and ecosystem, is announcing today that Snowflake has joined as a general member. Snowflake enables thousands of organizations to unite siloed data, discover and securely share data, power…
Data-on-eks issues – Kubernetes – Ray
Hey Guys, I used the tf code provided at github.com/awslabs/data-on-eks/tree/main/ai-ml/jupyterhub to deploy jupyterhub on eks.While testing I get the below errors. Please guide how to resolve it? I am new to eks as well as jupyterhub. Based on the documentation at JupyterHub on EKS | Data on EKS, I expected…
V1IngressBackendBuilder – client-java-api 11.0.0 javadoc
Latest version of io.kubernetes:client-java-api javadoc.io/doc/io.kubernetes/client-java-api Current version 11.0.0 javadoc.io/doc/io.kubernetes/client-java-api/11.0.0 package-list path (used for javadoc generation -link option) javadoc.io/doc/io.kubernetes/client-java-api/11.0.0/package-list Read more here: Source link
HPC Kubernetes: AI Training on 3,500 GPUs
To date, Kubernetes has largely steered clear of the high-performance computing (HPC), or supercomputing space. But with such a premium being put on GPUs for large machine learning these days, Kubernetes could provide a more dynamic way for managing vast fleets of GPUs, with the little help from tools that…
BentoML vs RayServe: a comparative analysis
As a seasoned enthusiast and practitioner of machine learning, I have delved into the complexities of model serving platforms, investigating their advantages and disadvantages as well as the overall value propositions that they offer. Throughout this journey, two names have emerged as frontrunners: BentoML vs RayServe. Developers and data scientists…
Artificial Intelligence Developer Job in SquareShift at Chennai,Other Tamil Nadu -Job Description #13524939
Artificial Intelligence Developer Job in SquareShift at Chennai,Other Tamil Nadu -Job Description #13524939 – Shine.com Hi Job Details The AI Developer or Machine Learning Engineer is responsible for designing, developing, and deploying machine learning models and AI solutions using Python, long-chain and Google Vertex AI. The primary focus is on…
S3 Express One Zone set to power generative AI workloads
AWS’ S3 object storage is shifting from being a data repository to a vital part of the stack for generative AI and machine learning development. That’s the idea behind S3 Express One Zone (EOZ), the public cloud’s latest S3 object storage service, according to Andy Warfield, vice president and…
dependency_licenses.csv – solr-operator – Git at Google
github.com/beorn7/perks/quantile,github.com/beorn7/perks/blob/v1.0.1/LICENSE,MIT github.com/cespare/xxhash/v2,github.com/cespare/xxhash/blob/v2.1.2/LICENSE.txt,MIT github.com/davecgh/go–spew/spew,github.com/davecgh/go-spew/blob/v1.1.1/LICENSE,ISC github.com/emicklei/go–restful/v3,github.com/emicklei/go-restful/blob/v3.9.0/LICENSE,MIT github.com/evanphx/json–patch/v5,github.com/evanphx/json-patch/blob/v5.6.0/v5/LICENSE,BSD-3-Clause github.com/fsnotify/fsnotify,github.com/fsnotify/fsnotify/blob/v1.6.0/LICENSE,BSD-3-Clause github.com/go–logr/logr,github.com/go-logr/logr/blob/v1.2.3/LICENSE,Apache-2.0 github.com/go–logr/zapr,github.com/go-logr/zapr/blob/v1.2.3/LICENSE,Apache-2.0 github.com/go–openapi/jsonpointer,github.com/go-openapi/jsonpointer/blob/v0.19.5/LICENSE,Apache-2.0 github.com/go–openapi/jsonreference,github.com/go-openapi/jsonreference/blob/v0.20.0/LICENSE,Apache-2.0 github.com/go–openapi/swag,github.com/go-openapi/swag/blob/v0.21.1/LICENSE,Apache-2.0 github.com/gogo/protobuf,github.com/gogo/protobuf/blob/v1.3.2/LICENSE,BSD-3-Clause github.com/golang/groupcache/lru,github.com/golang/groupcache/blob/41bb18bfe9da/LICENSE,Apache-2.0 github.com/golang/protobuf,github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause github.com/google/gnostic,github.com/google/gnostic/blob/v0.6.9/LICENSE,Apache-2.0 github.com/google/go–cmp/cmp,github.com/google/go-cmp/blob/v0.5.9/LICENSE,BSD-3-Clause github.com/google/gofuzz,github.com/google/gofuzz/blob/v1.2.0/LICENSE,Apache-2.0 github.com/google/uuid,github.com/google/uuid/blob/v1.3.0/LICENSE,BSD-3-Clause github.com/imdario/mergo,github.com/imdario/mergo/blob/v0.3.13/LICENSE,BSD-3-Clause github.com/josharian/intern,github.com/josharian/intern/blob/v1.0.0/license.md,MIT github.com/json–iterator/go,github.com/json-iterator/go/blob/v1.1.12/LICENSE,MIT github.com/mailru/easyjson,github.com/mailru/easyjson/blob/v0.7.7/LICENSE,MIT github.com/matttproud/golang_protobuf_extensions/pbutil,github.com/matttproud/golang_protobuf_extensions/blob/v1.0.4/LICENSE,Apache-2.0 github.com/moby/spdystream,github.com/moby/spdystream/blob/v0.2.0/LICENSE,Apache-2.0 github.com/modern–go/concurrent,github.com/modern-go/concurrent/blob/bacd9c7ef1dd/LICENSE,Apache-2.0 github.com/modern–go/reflect2,github.com/modern-go/reflect2/blob/v1.0.2/LICENSE,Apache-2.0 github.com/munnerz/goautoneg,github.com/munnerz/goautoneg/blob/a7dc8b61c822/LICENSE,BSD-3-Clause github.com/pkg/errors,github.com/pkg/errors/blob/v0.9.1/LICENSE,BSD-2-Clause github.com/pravega/zookeeper–operator/api/v1beta1,github.com/pravega/zookeeper-operator/blob/v0.2.15/LICENSE,Apache-2.0 github.com/prometheus/client_golang/prometheus,github.com/prometheus/client_golang/blob/v1.14.0/LICENSE,Apache-2.0 github.com/prometheus/client_model/go,github.com/prometheus/client_model/blob/v0.3.0/LICENSE,Apache-2.0 github.com/prometheus/common,github.com/prometheus/common/blob/v0.37.0/LICENSE,Apache-2.0 github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg,github.com/prometheus/common/blob/v0.37.0/internal/bitbucket.org/ww/goautoneg/README.txt,BSD-3-Clause github.com/prometheus/procfs,github.com/prometheus/procfs/blob/v0.8.0/LICENSE,Apache-2.0 github.com/robfig/cron/v3,github.com/robfig/cron/blob/v3.0.1/LICENSE,MIT github.com/spf13/pflag,github.com/spf13/pflag/blob/v1.0.5/LICENSE,BSD-3-Clause go.uber.org/atomic,github.com/uber-go/atomic/blob/v1.9.0/LICENSE.txt,MIT go.uber.org/multierr,github.com/uber-go/multierr/blob/v1.8.0/LICENSE.txt,MIT go.uber.org/zap,github.com/uber-go/zap/blob/v1.24.0/LICENSE.txt,MIT golang.org/x/net,cs.opensource.google/go/x/net/+/v0.7.0:LICENSE,BSD-3-Clause golang.org/x/oauth2,cs.opensource.google/go/x/oauth2/+/622c5d57:LICENSE,BSD-3-Clause golang.org/x/sys/unix,cs.opensource.google/go/x/sys/+/v0.5.0:LICENSE,BSD-3-Clause golang.org/x/term,cs.opensource.google/go/x/term/+/v0.5.0:LICENSE,BSD-3-Clause golang.org/x/text,cs.opensource.google/go/x/text/+/v0.7.0:LICENSE,BSD-3-Clause golang.org/x/time/rate,cs.opensource.google/go/x/time/+/v0.3.0:LICENSE,BSD-3-Clause gomodules.xyz/jsonpatch/v2,github.com/gomodules/jsonpatch/blob/v2.2.0/v2/LICENSE,Apache-2.0 google.golang.org/protobuf,github.com/protocolbuffers/protobuf-go/blob/v1.28.1/LICENSE,BSD-3-Clause gopkg.in/inf.v0,github.com/go-inf/inf/blob/v0.9.1/LICENSE,BSD-3-Clause gopkg.in/yaml.v2,github.com/go-yaml/yaml/blob/v2.4.0/LICENSE,Apache-2.0 gopkg.in/yaml.v3,github.com/go-yaml/yaml/blob/v3.0.1/LICENSE,MIT…
Senior Bioinformatics Software Engineer – Land A Remote Job From Top Employers
The Center for Applied Bioinformatics (CAB) at the St. Jude Children’s Research Hospital (SJCRH) is seeking a creative Software Engineer with a strong background in bioinformatics to join our development team to create and maintain our vital analytical infrastructure. The new hire will work closely with a team of computer…
AI startup Imbue spends $150 million on Dell servers
AI startup Imbue, which is building its own foundation models, has inked a $150 million deal with Dell for servers to train its emerging models. The two have co-designed a compute setup running inside AI cloud provider Voltage Park’s facilities, built on Dell PowerEdge XE9680 servers. Imbue, formerly known as…
JupyterHub custom server options drop down menus – Zero to JupyterHub on Kubernetes
gcerar November 27, 2023, 3:22pm 1 Is it possible to achieve something similar on bare-metal Z2JH deployment, as shown in the Figure below? I’m thinking of revamping our cluster and I would offering a selection of docker images, where users could pick any number of GPUs and reserve a certain…
PyTorch vs TensorFlow in 2023
The Ultimate Comparison: PyTorch vs TensorFlow in 2023 Practical Considerations when Comparing PyTorch with TensorFlow Availability of Models Model Deployment Ecosystem Differences Comparing PyTorch and TensorFlow on Model Availability Hugging Face Hub TensorFlow Models Migration Trends Jacks Conclusion Comparing PyTorch and TensorFlow on Model Deployment TensorFlow Serving TensorFlow Lite Torch…
V1CustomResourceDefinitionListFluentImpl – client-java-api 11.0.0 javadoc
Latest version of io.kubernetes:client-java-api javadoc.io/doc/io.kubernetes/client-java-api Current version 11.0.0 javadoc.io/doc/io.kubernetes/client-java-api/11.0.0 package-list path (used for javadoc generation -link option) javadoc.io/doc/io.kubernetes/client-java-api/11.0.0/package-list Read more here: Source link
5 Ways to Boost Your Marketability as a Tech Contractor
Whether you’re looking to earn some cash before the next full-time hiring boom or elevate your tech freelance career, knowing what employers are looking for when they hire tech contractors and how to market your skill-set can work to your advantage. The good news is there’s no shortage of opportunities….
Senior ML/AI Developer VAN465 Job in Airstack at Delhi -Job Description #13366250
Senior ML/AI Developer VAN465 Job in Airstack at Delhi -Job Description #13366250 – Shine.com Hi Job Details About Airstack Airstack is a developer platform that empowers developers to seamlessly query and integrate any web3 on-chain data and associated off-chain data into their applications. Superior to preceding platforms, Airstack facilitates intricate…
PDF Programming PyTorch for Deep Learning: Creating and Deploying Deep Learning Applications
Programming PyTorch for Deep Learning: Creating and Deploying Deep Learning ApplicationsMore:wldwakabooks.blogspot.com/?book=1492045357 Book Summary:Take the next steps toward mastering deep learning, the machine learning method thatâ??s transforming the world around us by the second. In this practical book, youâ??ll get up to speed on key ideas using Facebookâ??s open source PyTorch…
Setting CORS when creating a user server on Kubernetes via REST API – JupyterHub
Hi, I am having trouble setting up CORS options on a single user server that are being spun up. The error I am seeing: Access to fetch at ‘<URL>’ from origin ‘http://localhost:3000’ has been blocked by CORS policy: Response to preflight request doesn’t pass access control check: No ‘Access-Control-Allow-Origin’ header…
Vertex AI MLOps Engineer – IBU Consulting Pvt Ltd
Job Description: Job Summary: The Vertex AI MLOps Engineer plays a crucial role in the design, implementation, and maintenance of machine learning operations (MLOps) processes within the organization. The primary focus is on deploying and managing machine learning models using Google Cloud’s Vertex AI platform. This role requires a strong…
Klook leverages Google Cloud to enhance customer engagement via advanced Generative AI
Klook leverages Google Cloud to enhance customer engagement via advanced Generative AI In a collaboration aimed at expanding customer engagement and the scope of digital experiences on its platform, travel services and bookings platform Klook has joined forces with Google Cloud. This partnership leverages the capabilities of Google Cloud’s advanced…
[Hiring] QA Engineer Release Manager @Lifebit Biotech Ltd at Lifebit Biotech Ltd
Nov 22, 2023 – Lifebit Biotech Ltd is hiring a remote QA Engineer Release Manager. 📍Location: Europe. At Lifebit, we carve our own path. We’re open-source pioneers and our driving mission is to revolutionise bioinformatics and biomedical data analysis forever. Our product, Lifebit CloudOS, is the world’s first federated genomics…
NuGet Gallery | Microsoft.AspNetCore.OpenApi 7.0.0-preview.5.22303.8
Product Versions Compatible and additional computed target framework versions. .NET net7.0 net7.0 is compatible. net7.0-android net7.0-android was computed. net7.0-ios net7.0-ios was computed. net7.0-maccatalyst net7.0-maccatalyst was computed. net7.0-macos net7.0-macos was computed. net7.0-tvos net7.0-tvos was computed. net7.0-windows net7.0-windows…
PostgreSQL-Compatible Database for On-Premises and VMware Cloud Foundation
Google Cloud recently announced the general availability of AlloyDB Omni, a downloadable version of the PostgreSQL-compatible database service AlloyDB. The new version is designed to run on-premises, has built-in support for generative AI, and will be available on VMware Cloud Foundation. Initially introduced in preview last March, AlloyDB Omni maintains…
Hong Kong’s Klook supercharges innovation at scale with generative AI from Google Cloud
Google Cloud and Klook, Hong Kong’s platform for experiences and travel services, have on Wednesday announced a collaboration to amplify Klook’s activity content and customer engagement channels with generative artificial intelligence (AI) from Google Cloud. The duo said in a statement that the collaboration is starting with automated translation into…
Klook bolsters localised content and engagement with Google Cloud’s gen AI
Online travel platform Klook and Google Cloud have teamed up to further adopt generative AI to amplify the platform’s activity content and customer engagement channels. This comes after the launch of a pilot programme where Klook used Google Cloud’s PaLM 2 large language model via Google Cloud’s Vertex AI Model Garden to translate existing…
Klook supercharges innovation at scale with generative AI from Google Cloud, ETCIO SEA
Google Cloud and Klook, Asia’s leading platform for experiences and travel services, today announced a collaboration to amplify Klook’s activity content and customer engagement channels with generative AI from Google Cloud, starting with automated translation into 10 languages that captures both local-market nuances and Klook’s distinctive brand voice. The initiative…
Hub.db.type usage – Zero to JupyterHub on Kubernetes
Hello, members. Could someone tell me about hub.db.type database feature? Zero to JupyterHub with Kubernetes Configuration Reference The JupyterHub Helm chart is configurable by values in your config.yaml. In this way, you can extend user resources, build off of different Docker images, manage security and authentication, and mo… What pod…
Software Developer job with European Molecular Biology Laboratory (EMBL)
About the team/job EMBO is a not-for-profit organization that promotes excellence in life sciences in Europe and beyond. We fund talented researchers at all stages of their careers, stimulate scientific exchanges through high-quality academic publishing, conferences and lectures, and help build a research environment where scientists can achieve their best…
Deploying The Future: How Google Puts Machine Learning Into Action | by Daivi Sarkar | ProjectPro | Nov, 2023
Have you ever wondered how Google search results possibly know your thoughts before you even type them? Or how are YouTube’s recommendations consistently accurate? The answer is- data science and machine learning, and Google is a master of this powerful duo. Every time you enter a Google search query or…
kubernetes – Issues with respect to JupyterHub’s volume mount and custom-built images
We have JupyterHub setup on Kubernetes (AWS, kops, self-managed, z2jh.jupyter.org/en/stable/). The JupyterHub setup involves us using custom built images for our environments. We have some internal packages installed inside those images that are essential for our developers to work. Please note that these are legacy systems that cannot be modified…
Delivery Hero’s GitHub-Vertex AI Voucher Fraud Detection | by Agarapu Ramesh | Nov, 2023
Read more on Govindhtech.com Effective model maintenance is essential in machine learning’s ever-changing world. Fraud detection models must be redeployed often to combat human opponents that may reverse-engineer fraud engine logic and change their methods. At Delivery Hero, a prominent local delivery platform, the Incentive Fraud team builds ML-powered, rule-based…
Trying to spawn pods in other namespace – Zero to JupyterHub on Kubernetes
Hello manics, thank you for your quick response and the tips on further debugging!In the default setting everything works fine, I can even use a profile as long as I dont use the kubespawner_override.namespace option. Here are the logs from the profile+namespace setting with the debug logging:Hub: [I 2023-11-16 19:58:45.827…
Top cybersecurity product news of the week
Stream Security announces Cloud Twin cloudsecops platform November 14: Stream Security (formerly Lightlytics) has announced three new features for its Cloud Twin engine, a cloud security operations (cloudsecops) platform that can help detect and investigate threats and exposures in their cloud environments. The company claims it can now map cloud…
Cockroach Labs Reveals Integration Struggles in Multi-Cloud Environments According to Latest Survey
NEW YORK, Nov. 14, 2023 — Cockroach Labs, a leading provider of cloud-native distributed SQL databases, today unveils its “The State of Multi-Cloud” report. According to the report, cloud architects and engineers agree on the many benefits (and challenges) of multi-cloud—but that doesn’t mean they’re happy with cloud service providers…
Remote Senior Cloud Operations Engineer Job at Linux Foundation
Company Description The Linux Foundation is a driving force in fostering open-source collaboration and supporting communities across a range of projects, including PyTorch. We’re dedicated to enhancing and expanding our infrastructure to meet the growing demands of PyTorch and related AI projects. We are seeking a Senior Cloud Operations Engineer…
Spawn collaborative user pod by using existing spawner.profile_list to override – Zero to JupyterHub on Kubernetes
Hi there,I’m able to make a basic jupyterhub with the collaboration server working following Real-time collaboration without impersonation I’m looking for a potential way to spawn this collaborative user’s pod by using the existing profile_list that I have already defined: profile_map = { ‘oauth_group_name’: { ‘display_name’: display_name, ‘description’: description, ‘default’:…
With Conductor, Orkes Tackles LLM Orchestration Workflows
Amid all the hullabaloo about generative AI and large language models (LLMs), developers still have practical questions about how, exactly, to add the benefits of LLMs to their applications. Questions like: Do I need to maintain external stacks to manage the AI side of my application outside of where the…
Conjur OpenAPI
The Conjur OpenAPI specification provides a standardized, machine-readable version of the Conjur API that can be used to automatically generate API documentation, to generate Conjur client libraries in your language of choice, and to facilitate exploring the Conjur API using popular tools like Postman. This project simplifies end users’ ability…
Big talk and big bucks in generative AI, but is it peaking?
The battle of the generative artificial intelligence models grew even more fierce this week, with little sign of abating. We saw new OpenAI capabilities — which in turn suggest a whole new enterprise software market and even app stores — along with Elon Musk’s bold xAI, Kai-Fu Lee’s Chinese company 01.AI…
JupyterHub on Kubernetes cannot failed to cull user pods
I implemented JupyterHub using a Helm chart on a local Kubernetes cluster on VMware virtual machines. I want to cull users after they have been inactive for a while, but it seems not to work. This error log from the hub pod (pod named hub-545895f988-vmj2k) might be related: [W 2023-11-09…
Google Announces Expansion of AI Partnership with Anthropic
Partnership includes important new collaborations on AI safety standards, committing to the highest standards of AI security, and use of TPU v5e accelerators for AI inference Google announced an expansion of its partnership with Anthropic, committing to the highest standards of AI security and safety, and that Anthropic will leverage…
Rafay Launches AI Infrastructure Templates to Help Enterprise Platform Teams Develop AI Applications
Templates enable platform teams to build automation for cloud environments and Kubernetes, jumpstarting adoption of Large Language Models (LLMs), while supporting traditional AI applications leveraging SLURM, MLFlow and Kubeflow Rafay Systems, the leading platform provider for Cloud and Kubernetes Automation announced the availability of curated infrastructure templates for Generative AI…
jupyter notebook – Automation of PV and creation of folders in NFS server for Jupyterhub on Kubernetes
I have used the following GitHub link for jupyterhub installation:github.com/bitnami/charts/tree/main/bitnami/jupyterhub My problem is while user tries to log in jupyterhub it will create PVC for each user from helm side and we need to create PV and NFS folders from our side. Doing this process for each user is not…
Real-time collaboration for jupyterhub – Zero to JupyterHub on Kubernetes
Hi there,I’ve been playing around with RTC extension on jupyterhub recently and I’ve been stuck at creating-collaboration-accounts for a while. It mentions This configuration code runs when jupyterhub starts up, so I included the example code block under hub.extraConfig.’myConfig.py’, then I got this error: TypeError: ‘LazyConfigValue’ object is not subscriptable….
Trying to upgrade jupyterhub from helmchart 2.0.0 to 3.1.0 – Zero to JupyterHub on Kubernetes
Hello, I’ve been trying to upgrade helmchart from 2.0.0 to the latest 3.1.0 (speaking as of date 8 Nov. 2023) on k8s (v1.25) AWS cluster. I got this error message when I check the logs of helmrelease Last Helm logs: Patch Deployment “hub” in namespace jupyterhub Patch Deployment “proxy” in…
10 AI Code Generation Trends: See Examples
Artificial Intelligence (AI) has become an integral part of various disciplines, and software development is no exception. With the advent of AI, code generation has witnessed significant advancements. Today, AI applications can independently generate code, simplifying and accelerating the software development process. Exploring AI and code generation Introducing AI-generated coding…
Unhealthy hub pod, possible network problems? – Zero to JupyterHub on Kubernetes
We’re trying to resize (reduce) a z2jh running on an OpenStack Magnum-created k8s, and now seeing some problems with the hub pod, which may be related to networking. From the hub logs: [I 2023-11-07 17:59:20.318 JupyterHub app:1984] Not using allowed_users. Any authenticated user will be allowed. [D 2023-11-07 17:59:20.344 JupyterHub…
Rafay Launches Infrastructure Templates for Generative AI to Help Enterprise Platform Teams Bring AI Applications to Market Faster
Templates enable platform teams to build automation for cloud environments and Kubernetes, jumpstarting adoption of Large Language Models (LLMs), while supporting traditional AI applications leveraging SLURM, MLFlow and Kubeflow SUNNYVALE, Calif. & CHICAGO, November 07, 2023–(BUSINESS WIRE)–Rafay Systems, the leading platform provider for Cloud and Kubernetes Automation, today announced the…
Meet Redocly CLI: The Modern OpenAPI Sidekick
Redocly CLI is a brilliant new tool from the folks who made ReDoc, the first beautiful API reference documentation tool powered by OpenAPI. This CLI tool goes a lot further than documentation, and helps with “linting” (automated API Style Guides), and solves the biggest problem that I had previously been…
Software Engineer – Data Discovery
Candidatul Ideal You have •Degree in computer science or a related field;•minimum two years experience in software development;•good knowledge of Java, at least one Javascript framework like React or Angular, as well as indexing and database technologies like Lucene, SolR, SQL;•knowledge of REST APIs and how to interface with them;•experience…
How to replace the private image forcely? – Zero to JupyterHub on Kubernetes
Hello, members 1. Quetions. I’m creating a custom image for Z2JH. When I update the private image, I want to replace the image.(It means I want to use the new image in Z2JH).But I don’t know how to force-pull the image.Does anyone know how to do it? configuration. singleuser: image:…
MongoDB Builds out Its Full Platform Play
MongoDB, the company behind the document database of the same name, has been holding a series of one-day road show events, aptly called “.local,” around the world this year. Two of these roadshow conferences, in New York on June 22 and in London on Sept. 26, served as launch vehicles…
Building multi-tenant JupyterHub Platforms on Amazon EKS
Introduction In recent years, there’s been a remarkable surge in the adoption of Kubernetes for data analytics and machine learning (ML) workloads in the tech industry. This increase is underpinned by a growing recognition that Kubernetes offers a reliable and scalable infrastructure to handle these demanding computational workloads. Furthermore, a…
Multiple courses for one instructor/grader in one single user server in JupyterHub on Kuberentes
Hi, I’m trying to set up nbgrader with JupyterHub with KubeSpawner. I want to achieve following: – one instructor is able to work with multiple courses in one notebook instance – several graders are able to access relevant formgraders – students are able to subscribe to multiple courses = see assignments…
Dangling user pods – Zero to JupyterHub on Kubernetes
Hello I am deploying JupyterHub in our Kubernetes environment. I noticed that the pods of the user-notebook are not killed due to inactivity, but they are when the user performs an explicit logout.This is my logs: [D 2023-10-30 14:25:26.988 JupyterHub reflector:289] Connecting pods watcher [D 2023-10-30 14:25:37.008 JupyterHub reflector:374] pods…
How to Solve the GPU Shortage Problem With Automation
GPU instances have never been as precious and sought-after as they have since generative AI captured the industry’s attention. Whether it’s due to broken supply chains or the sudden demand spike, one thing is clear: Getting a GPU-powered virtual machine is harder than ever, even if a team is fishing…
Managed singleuser service on kubernetes with separated hub and proxy pods – Zero to JupyterHub on Kubernetes
KrKO_o October 28, 2023, 1:58pm 1 I’m deploying a jupyterhub instance to run nbgrader with multiple courses using the Z2JH helm chart. On startup the hub starts a managed singleuser service for each course. The problem comes, when I want to make the services publicly available. There are 3 scenarios…
Z2JH default Persistent Volume Claim – Zero to JupyterHub on Kubernetes
Zero to JupyterHub with Kubernetes uses by default SQLite as the database (source: Configuration Reference — Zero to JupyterHub with Kubernetes documentation). This default database is stored in a default Persistent Volume Claim defined in github.com/jupyterhub/zero-to-jupyterhub-k8s/blob/4103cfe1089a3f6df69b0fae97442be183ae5e12/jupyterhub/templates/hub/pvc.yaml. The documentation says By default, this disk is created by the cloud provider using…
Accessing a Google Storage Bucket mounted as a Persistent Volume – Zero to JupyterHub on Kubernetes
That’s good to know; probably means my error is somewhere in my config. I’ll try to dump the relevant settings. Output of kubectl get pod while starting a jupyterhub user server: NAME READY STATUS RESTARTS AGE continuous-image-puller-972b7 1/1 Running 0 24m continuous-image-puller-tz5ls 1/1 Running 0 26h gcs-fuse-csi-static-pvc 2/2 Running 0…
Unlocking the Power of Kubeflow Pipelines v2 for ML Efficiency | by Vishnu Adithyan | SquareShift | Oct, 2023
In today’s tech-driven world, machine learning is a vital tool for businesses of all sizes. However, getting from concept to reality with ML models can be a challenging journey. That’s where Kubeflow Pipelines (KFP) v2 comes in, promising to make this journey smoother. Let’s explore what’s new and exciting in…
AI Infra Day | Hands-on Lab: CV Model Training with PyTorch & Alluxio on Kubernetes
This hands-on session discusses best practices for using PyTorch and Alluxio during model training on AWS. Shawn and Lu provide a step-by-step demonstration of how to use Alluxio on EKS as a distributed cache to accelerate computer vision model training jobs that read datasets from S3. This architecture significantly improves…
Custom Z2JH image creation using jupyter-repo2docker – Zero to JupyterHub on Kubernetes
Hello, members. 1. Goal I would like to create a custom image for Z2JH using jupyter-repo2docker command. jupyter-repo2docker github.com/norvig/pytudes works fine. 2. Question Does Z2JH use jupyter-repo2docker for creating a support images (ex. jupyter/pyspark-notebook) ? Is Z2JH base_image jupyter/base-notebook? Does anyone know how to avoid this error? (Maybe macOS docker…
kubernetes – Load balancing between Slurm clusters
What strategy of load balancing in k8s would be recommended between Slurm (think SGE) clusters? The reason I raise this is Slurm has a Pythonic API governing the queuing system. Information can freely pass from the queuing system to the load balancer in Nginx (k8s) via the API. The load…
Associate Engineer Bioinformatics, Biopharma Libraries – Twist Bioscience
Programmable DNA, the software of Life, is finally here! Twist Bioscience is developing a disruptive Synthetic DNA technology that will change the world, enabling widespread health and sustainability. Synthetic biologists use our products to engineer how organisms produce cures to diseases; everyday chemicals are made using the atmosphere as…
Senior Software QA Engineer, Platform @ RStudio
Posit is seeking a QA engineer with strong automation and environment provisioning skills to join our Platform Team. The team works across all Posit products, developing shared components and enabling customers to use the products better. This is a high-leverage team that can impact many people and customers. You’ll be…
Looking for a Job in Croatia? This Week’s Top 10 from Posao.hr (October 22, 2023)
October 22, 2023 – Looking for a job in Croatia? A weekly feature on TCN, in partnership with leading job site agency, Posao.hr, who present a selection of weekly job listings. Strabag AG is looking for Senior DevOps Engineer / Architect (m/f/d). The location of work is Belgrade and Zagreb….
Olusegun Ajose – AI/ML Software Engineer – Paris, Paris – France
Ruffin Galactic, Atlanta US (Remote) | MACHINE LEARNING ENGINEER JUL 2023 – PRESENT Developed and deployed a machine learning pipeline (machine failure prediction model) using Vertex AI SDK for Python and Sklearn. Created a deployment script to automate the deployment of Anything LLM (based on Pinecone and OpenAI GPT) to Digital…
Building faster and smarter: Harnessing the power of the right AI tech
Gone are the days (for most of us) of needing to craft neural networks layer by layer and neuron by neuron on a scarce GPU server. As AI models increase in size, complexity, and infrastructure demands, the AI tools ecosystem is keeping pace by developing higher-level abstractions for ease of…
Jupyterhub for multiple server nodes – JupyterHub
nktra October 19, 2023, 8:01am 1 Hi. I’m very new to JupyterHub. I want to set up JupyterHub with multiple server nodes. Let’s say I have 3 server nodes, and each of them has 3 GPU cards installed. Some features that I need: Only one GPU is allowed for one…
Jupyterhub helm chart 3.1.0+k8s 1.27.6: User pods not spawning got TimeoutError – Zero to JupyterHub on Kubernetes
Context k8s: v1.27.6helm: v3.13.0jupyterhub helm chart: 3.1.0 # configs.yaml proxy: service: type: NodePort ingress: enabled: true annotations: kubernetes.io/ingress.class: nginx nginx.ingress.kubernetes.io/proxy-body-size: 512m cert-manager.io/cluster-issuer: letsencrypt-prod hosts: – xxxxxxxxxxxxxxxxxxxxxxxx tls: – hosts: – xxxxxxxxxxxxxxxxxxxxxxxx secretName: codebook-tls singleuser: startTimeout: 300 debug: enabled: true Deployment seems to work fine: NAME READY STATUS RESTARTS AGE continuous-image-puller-2v74w…
Revolutionizing Business-customer Conversations with Open API Smart Conversations Platform
Empowering reseller partners with professional services teams, the company encourages them to harness BOT developments and integration opportunities to drive revenues. At the core of its flagship offering, the Mehery Smart Conversations platform serves as a social messenger aggregator, boasting no-code bots, a BOT builder, and a human interface. This…
From Java Engineer to Machine Learning Lead: Navigating Career Growth
Machine Learning (ML) technologies have become akin to what the web was two decades ago—a transformative force with broad applications. Nowadays, you can discover creative uses for ML across various domains, and we’ll undoubtedly see the rise of technology adoption across industries soon. We’ve asked Ihar Nestsiarenia, Lead Software Engineer…
V1PriorityClass – client-java-api 15.0.1 javadoc
Latest version of io.kubernetes:client-java-api javadoc.io/doc/io.kubernetes/client-java-api Current version 15.0.1 javadoc.io/doc/io.kubernetes/client-java-api/15.0.1 package-list path (used for javadoc generation -link option) javadoc.io/doc/io.kubernetes/client-java-api/15.0.1/package-list Read more here: Source link
Bendigo Bank rebuilds digital banking on Google Cloud
Bendigo and Adelaide Bank has rebuilt its digital banking system on Google Cloud, paving the way for a more robust and personalised customer experience and faster, more reliable rollout of new features. Since moving to Google Cloud in May 2023, Bendigo and Adelaide Bank’s new, fully automated, consumer-facing digital banking…
Advanced Bioinformatics Data Scientist job at BenevolentAI, London October 2023
We are keen to hear from Bioinformaticians and Data Scientists with a proven track record in applying genomics and biomedical dataset analysis to support late stage drug discovery and clinical trial design. You will join the Portfolio Delivery team and the Biomedical Informatics department, working as part of a cross-functional…