As part of this effort, we've started testing the upgrade procedures, the latest being to the final Mitaka release. If you're here to see some fancy load tests, keep reading below, but some interesting details on the upgrade:
- We build our own RPMs to include a few patches from post-Mitaka upstream (the most important being the trustee user to support lifecycle operations on the bays) and some CERN customizations (removal of neutron LBaaS and floating ips which we don't yet have, adding the CERN Certificate Authority, ...). Check here for the patches and build procedure
- We build our Fedora Atomic 23 image to get more recent versions of docker and kubernetes (1.10 and 1.2 respectively), plus support for an internal distributed filesystem called CVMFS. We do use the upstream disk-imagebuilder procedure with a few additional elements available here
While discussing how we could further test the service, we thought of this kubernetes blog post, achieving 1 million requests per second against a service running on a kubernetes cluster. We thought we could probably do the same. Requirements included:
- kubernetes 1.2, which our recent upgrade offered
- available resources to deploy the cluster, and luckily we were installing a new batch of a few hundred physical nodes which could be used for a day or two
So along with the upgrade, Bertrand and Mathieu got to work to test this setup and we quickly got it up and running.
We ended up trying a bit more and doubled the number to 2 million requests per second :)
We learned a few things on the way:
- set Heat's max_resources_per_stack to something big. Magnum stacks create a lot of these, and with bays of hundreds of nodes the value gets high enough that unlimited (-1) is tempting and we have it like that now. It leaves the option for people to deploy a stack with so many resources that Heat could break, so we'll investigate what the best value is
- while creating and deleting many large bays, Heat shows errors like 'TimeoutError: QueuePool limit of size ... overflow ... reached' which we've seen in the past for other OpenStack services. We'll contribute the patch to fix it upstream if not there yet
- latency values get high even before the 1 million barrier, we'll check further the demo code and our setup (using local disk, in this case SSDs instead of the default volume attachment in Magnum should help)
- Heat timeout and retrial configuration values need to be tuned to manage very large stacks. We're still not sure what are the best values, but will update the post once we have them
- Magnum shows 'Too many files opened' errors, we also have a fix to contribute for this one
- Nova, Cinder (bay nodes use a volume), Keystone and all other OpenStack services scaled beautifully, our cloud usually has a rate of ~150 VMs created and deleted per hour, here's the plot for the test period, we eventually tried bays up to 1000 nodes
And what's next?
- Larger bays: at the end of these tests we deployed a few bigger bays with 300, 500 and 1000 nodes. And in just a couple weeks there will be a new batch of physical nodes arriving, so we plan to upgrade Heat to Mitaka and build on the recent upstream work (by Spyros together with Ton and Winnie from IBM) adding Magnum scenarios to Rally to run additional scale tests and see where it breaks
- Bay lifecycle: we stopped at launching a large number of requests in a bay, next we would like to perform bay operations (update of number of nodes, node replacement) and see which issues (if any) we find in Magnum
- New features: lots of upstream work going on, so we'll do regular Magnum upgrades (cinder support, improved bay monitoring, support for some additional internal systems at CERN)
And there's also Swarm and Mesos, we plan on testing those soon as well. And kubernetes updated their test, so stay tuned...
Acknowledgements
- Bertrand Noel, Mathieu Velten and Spyros Trigazis from CERN IT, for the work upstream and integrating Magnum at CERN, and on getting these demos running
- Rackspace for their support within the CERN Openlab on running containers at scale
- Indigo Datacloud building a platform as a service for e-science in Europe
- Kubernetes for an awesome tool and the nice demo
- All in the CERN OpenStack Cloud team, for a great service (especially Davide Michelino and Belmiro Moreira for all the work integrating Neutron at CERN)
- The upstream Magnum team, for building what is now looking like a great service, and we look forward for what's coming next (bay drivers, bare metal support, and much more)
- Tim, Arne and Jan for letting us use the new hardware for a few days
jual viagra
ReplyDeletejual viagra jakarta
jual viagra di jakarta
jual viagra asli jakarta
viagra asli
viagra asli jakarta
viagra asli di jakarta
viagra jakarta
toko viagra
toko viagra asli jakarta
toko viagra jakarta
toko viagra di jakarta
toko viagra asli di jakarta
agen viagra
agen viagra jakarta
agen viagra asli jakarta
agen viagra di jakarta
agen viagra asli di jakarta
toko viagra
viagra usa
viagra original
obat viagra
obat kuat viagra
viagra asli
viagra
viagra asli
jual viagra
Great Article Cloud Computing Projects
DeleteNetworking Projects
Final Year Projects for CSE
JavaScript Training in Chennai
JavaScript Training in Chennai
The Angular Training covers a wide range of topics including Components, Angular Directives, Angular Services, Pipes, security fundamentals, Routing, and Angular programmability. The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training
Thank you sharing this Information
ReplyDeleteI also found Various useful links related to Devops, Docker & Kubernetes
Kubernetes Kubectl Commands CheatSheet
Introduction to Kubernetes Networking
Basic Concept of Kubernetes
Kubernetes Interview Question and Answers
Kubernetes Sheetsheat
Docker Basic Tutorial
Linux Sar Command Tutorial
Linux Interview Questions and Answers
Docker Interview Question and Answers
OpenStack Interview Questions and Answers
Thanks for sharing the valuable information. It was a great information.
ReplyDeleteDocker and Kubernetes Training
Kubernetes Online Training
Docker Online Training
Docker Training in Hyderabad
Thanks for sharing the valuable content , its such a very informational article.
ReplyDeleteclick here to know more about Kubernetes.
Your blog is in a convincing manner, thanks for sharing such an information with lots of your effort and time Kubernetes online training
ReplyDeleteKubernetes online course
Kubernetes training
I needed to peruse this multiple times since I needed to make certain on a portion of your focuses. I concur with nearly everything here, and I am intrigued with how well you composed this article.
ReplyDeleteSEO services in kolkata
Best SEO services in kolkata
SEO company in kolkata
Best SEO company in kolkata
Top SEO company in kolkata
Top SEO services in kolkata
SEO services in India
SEO copmany in India
If I had to give a prime example of great quality content, this article would be one. It's well-written material that keeps your interest well.
ReplyDeleteDenial management software
Denials management software
Hospital denial management software
Self Pay Medicaid Insurance Discovery
Uninsured Medicaid Insurance Discovery
Medical billing Denial Management Software
Self Pay to Medicaid
Charity Care Software
Patient Payment Estimator
Underpayment Analyzer
Claim Status
Your blog is in a convincing manner, thanks for sharing such an information with lots of your effort and time
ReplyDeleteKubernetes online training
Kubernetes online course
Nice post.
ReplyDeleteAngular JS online training
Angular JS training
App V online training
App V training
Application packaging online training
Application packaging training
Blockchain online training
Blockchain training
C online training
C training
Data power online training
Data power training
Data Stage online training
روش کاشت مو SUT در مقایسه با تکنیک های دیگر از قبیل FIT و FUT روش جدیدتر و موفق تری است که تمامی مراحل آن، از برداشت تا کاشت فولیکول های مو، توسط دستگاه های اتوماتیک صورت میگیرد. از آنجایی که در کاشت مو SUT تمامی مراحل توسط دستگاه انجام می گیرد، میزان تخریب ریشه مو، درد و خونریزی کم است.
ReplyDeleteبت فوروارد
ReplyDeleteتک بت
شرط بندی فوتبال
بازی انفجار
پیش بینی فوتبال
خرید vpn
کلید سازی شبانه روزی
کلید سازی سیار
کلید سازی سیار و شبانه روزی
ReplyDeleteI am reading your post from the beginning, it was so interesting to read & I feel thanks to you for posting such a good blog, keep updates regularly.I want to share about Mulesoft training .
Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
ReplyDeletebest mulesoft online training
https://tourism-blog.jimdosite.com/
ReplyDeleteThanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website blockchain online training
ReplyDeleteThanks for sharing the valuable information.
ReplyDeleteDevOps Training
DevOps Online Training
data science training
ReplyDeletepython training
angular js training
selenium trainings
abinitio training
ReplyDeletespark training
scala training
azure devops training
Thanks for the blog article.Thanks Again. Keep writing.
ReplyDeletedata science training
teradata training
oracle bpm training
coin haber - koin haber - kripto para haberleri - coin haber - instagram video indir - instagram takipçi satın al - instagram takipçi satın al - tiktok takipçi satın al - instagram takipçi satın al - instagram takipçi satın al - instagram takipçi satın al - instagram takipçi satın al - instagram takipçi satın al - binance güvenilir mi - binance güvenilir mi - binance güvenilir mi - binance güvenilir mi - instagram beğeni satın al - instagram beğeni satın al - google haritalara yer ekleme - btcturk güvenilir mi - binance hesap açma - kuşadası kiralık villa - tiktok izlenme satın al - instagram takipçi satın al - sms onay - paribu sahibi - binance sahibi - btcturk sahibi - paribu ne zaman kuruldu - binance ne zaman kuruldu - btcturk ne zaman kuruldu - youtube izlenme satın al - torrent oyun - google haritalara yer ekleme - altyapısız internet - bedava internet - no deposit bonus forex - erkek spor ayakkabı - tiktok jeton hilesi - tiktok beğeni satın al - microsoft word indir - misli indir - instagram takipçi satın al
ReplyDeleteAivivu đại lý vé máy bay, tham khảo
ReplyDeleteve may bay di my gia re
cách mua vé máy bay giá rẻ từ mỹ về việt nam
thông tin chuyến bay từ canada về việt nam
vé máy bay nhật việt
vé máy bay vietjet từ hàn quốc về việt nam
Vé máy bay từ Đài Loan về Việt Nam
các khách sạn cách ly ở hà nội
chuyen bay danh cho chuyen gia
takipçi satın al
ReplyDeleteinstagram takipçi satın al
https://www.takipcikenti.com
toptan iç giyim tercih etmenizin sebebi kaliteyi ucuza satın alabilmektir. Ürünler yine orjinaldir ve size sorun yaşatmaz. Yine de bilinen tekstil markalarını tercih etmelisiniz.
ReplyDeleteDigitürk başvuru güncel adresine hoşgeldiniz. Hemen başvuru yaparsanız anında kurulum yapmaktayız.
tutku iç giyim Türkiye'nin önde gelen iç giyim markalarından birisi olmasının yanı sıra en çok satan markalardan birisidir. Ürünleri hem çok kalitelidir hem de pamuk kullanımı daha fazladır.
nbb sütyen hem kaliteli hem de uygun fiyatlı sütyenler üretmektedir. Sütyene ek olarak sütyen takımı ve jartiyer gibi ürünleri de mevcuttur. Özellikle Avrupa ve Orta Doğu'da çokça tercih edilmektedir.
yeni inci sütyen kaliteyi ucuz olarak sizlere ulaştırmaktadır. Çok çeşitli sütyen varyantları mevcuttur. iç giyime damga vuran markalardan biridir ve genellikle Avrupa'da ismi sıklıkla duyulur.
iç giyim ürünlerine her zaman dikkat etmemiz gerekmektedir. Üretimde kullanılan malzemelerin kullanım oranları, kumaşın esnekliği, çekmezlik testi gibi birçok unsuru aynı anda değerlendirerek seçim yapmalıyız.
iç giyim bayanların erkeklere göre daha dikkatli oldukları bir alandır. Erkeklere göre daha özenli ve daha seçici davranırlar. Biliyorlar ki iç giyimde kullandıkları şeyler kafalarındaki ve ruhlarındaki özellikleri dışa vururlar.
marsbahis
ReplyDeletebetboo
sultanbet
marsbahis
betboo
sultanbet
ReplyDeleteبرخي عيبهاي جاروبرقي، تنها به کمي دانش و تجربه نياز دارد تا تعمير جاروبرقي در منزل انجام گيرد
و نيازي به مراجعه به نمايندگي نباشد. اما خرابي جاروبرقي، هميشه به دست خود شما قابل حل نيست و در بسياري موارد، به وجود يک نيروي متخصص نياز است
. بنابراين در صورت در دست داشتن ضمانت نامه، به نمايندگي تعمير جاروبرقي مراجعه کنيد و در غير اين صورت از دانش يک تعميرکار بهره ببريد.
البته براي مراجعه به نمايندگي، نياز قطعي به ضمانت نامه نيست و خدمات نمايندگيها شامل حال هرگونه مراجعهکنندهاي ميشوند
http://fanihub.ir/%d8%aa%d8%b9%d9%85%db%8c%d8%b1-%d8%ac%d8%a7%d8%b1%d9%88%d8%a8%d8%b1%d9%82%db%8c/%d8%ac%d8%a7%d8%b1%d9%88%d8%a8%d8%b1%d9%82%db%8c/
تعميرکار جاروبرقي
تعمير جاروبرقي در منزل
카지노사이트 value the article post.Thanks Again. Really Great.
ReplyDelete온라인카지노 Just wanna input on few general things, The website style is
ReplyDeleteperfect, the articles is very fantastic :D.
After going over a few of the blog posts on your web page,
ReplyDeleteI honestly like your way of writing a blog. 토토 I book-marked it to my bookmark webpage list and will be checking back soon. Take a look at my
web site too and let me know how you feel.
토토 I have express a few of the articles on your website now, and I really like your style of blogging. I added it to my favorite’s blog site list and will be checking back soon…
ReplyDeleteI have to convey my respect for your kindness for all those that require guidance on this one field. Your special commitment to passing the solution up and down has been incredibly functional and has continually empowered most people just like me to achieve their dreams. Your amazing insightful information entails much to me and especially to my peers.
ReplyDeleteđăng ký bay từ mỹ về việt nam
vé máy bay từ úc về việt nam bao nhiêu
Lịch bay từ Hàn Quốc về Việt Nam hôm nay
Đặt vé máy bay Bamboo tu Nhat Ban ve Viet Nam
săn vé may bay giá rẻ tu Dai Loan ve Viet Nam
mua vé máy bay từ canada về việt nam
Thanks for sharing this marvelous post. I m very pleased to read this article.
ReplyDelete송송넷
I will recommend your website to everyone. You have a very good gloss. Write more high-quality articles. I support you.
ReplyDelete바카라사이트
Thanks for such a valuable post. I am waiting for your next post, I have enjoyed a lot reading this post keep it up.
ReplyDelete카지노사이트
Your blog is really nice. Its sound really good
ReplyDelete토토
Great job for publishing such a beneficial web site
ReplyDelete온라인카지노
Thank you so much for sharing this Informative article with us. I really love the way of your presentation. Please keep sharing more
ReplyDelete송송넷
thanks admin good article HDE Bilişim
ReplyDeleteAlışveriş
Compo Expert
Multitek
Seokoloji
Vezir Sosyal Medya
Adak
Maltepe Adak
ReplyDeleteI would like to thank you for the efforts you have made in writing this article. I am hoping the same best work from you in the future as well. In fact your creative writing abilities has inspired me to start my own Blog Engine blog now. Really the blogging is spreading its wings rapidly. Your write up is a fine example of it 청마담
I envy your piece of work, appreciate it for all the good content.
ReplyDelete메이저사이트
경마
온라인경마
There is perceptibly a lot to realize about this. I believe you made various nice points in features also.
ReplyDelete카지노
사설토토
I simply discovered this web journal and have high trusts in it to proceed. Keep up the considerable work, its elusive great ones. I have added to my top choices. Much obliged to You.
ReplyDelete파워볼
While looking for articles on these topics, I came across this article on the site here. As I read your article, I felt like an expert in this field. I have several articles on these topics posted on my site. Could you please visit my homepage? 토토사이트모음
ReplyDeleteWhat a nice post! I'm so happy to read this. baccarat What you wrote was very helpful to me. Thank you. Actually, I run a site similar to you. If you have time, could you visit my site? Please leave your comments after reading what I wrote. If you do so, I will actively reflect your opinion. I think it will be a great help to run my site. Have a good day.
ReplyDeleteWhat a post I've been looking for! I'm very happy to finally read this post. 토토사이트 Thank you very much. Can I refer to your post on my website? Your post touched me a lot and helped me a lot. If you have any questions, please visit my site and read what kind of posts I am posting. I am sure it will be interesting.
ReplyDeleteI can’t thank you enough. دانلود آهنگ
ReplyDeleteLooking at this article, I miss the time when I didn't wear a mask. 오공슬롯 Hopefully this corona will end soon. My blog is a blog that mainly posts pictures of daily life before Corona and landscapes at that time. If you want to remember that time again, please visit us.
ReplyDeleteCasino 먹튀검증업체 My betting Style
ReplyDeletetiktok jeton hilesi
ReplyDeletetiktok jeton hilesi
referans kimliği nedir
gate güvenilir mi
tiktok jeton hilesi
paribu
btcturk
bitcoin nasıl alınır
yurtdışı kargo
.You showed me what true friendship looks like
ReplyDelete.I have never thought that I will ever be able to find a friend in my adult life. But you truly saved me
.I cannot thank you enough for everything you do for me, mate. دانلود آهنگ سینا درخشنده آدم برفی
I like the helpful info you provide in your articles. I’ll bookmark your blog and check again here frequently. I’m quite sure I’ll learn plenty of new stuff right here! Good luck for the next. 스포츠토토
ReplyDeleteویزیت پزشک در منزل
ReplyDeletePretty useful article. I merely stumbled upon your internet site and wanted to say that I’ve very favored learning your weblog posts. Any signifies I’ll be subscribing with your feed and I hope you publish once additional soon. 메이저사이트
ReplyDeleteThat's a great article! The neatly organized content is good to see. Can I quote a blog and write it on my blog? My blog has a variety of communities including these articles. Would you like to visit me later? 메이저안전놀이터
ReplyDeleteAs the Internet develops further in the future, I think we need to collect materials that people might be interested in. Among the data to be collected, your 메가슬롯 will also be included.
ReplyDeleteNice Post
ReplyDeletehttps://crackhow4.com/sigmakey-box-full-crack
Nice Post
ReplyDeletehttps://crackhow4.com/ableton-live-crack-download
Nice Post
ReplyDeletehttps://crackhow4.com/serato-dj-pro-crack-license-key
Nice Post
ReplyDeletehttps://crackhow4.com/cool-edit-pro-crack-multimedia
Nice Post
ReplyDeletehttps://crackhow4.com/guitar-rig-pro-crack-download
Nice Post
ReplyDeletehttps://crackhow4.com/avst-antitrack-premium-crack-offline-installer
Nice Post
ReplyDeletehttps://crackhow4.com/mirillis-action-crack/
Nice Post
ReplyDeletehttps://crackhow4.com/videoproc-crack-download
Nice Post
ReplyDeletehttps://crackhow4.com/bootstrap-studio-crack-torrent/
Nice Post
ReplyDeletehttps://crackhow4.com/bootstrap-studio-crack-torrent
I finally found what I was looking for! I'm so happy. 사설토토사이트 Your article is what I've been looking for for a long time. I'm happy to find you like this. Could you visit my website if you have time? I'm sure you'll find a post of interest that you'll find interesting.
ReplyDeleteseo fiyatları
ReplyDeletesaç ekimi
dedektör
instagram takipçi satın al
ankara evden eve nakliyat
fantezi iç giyim
sosyal medya yönetimi
mobil ödeme bozdurma
kripto para nasıl alınır
Pretty! This has been an extremely wonderful post. Thank you for providing this
ReplyDeletehttps://iransafe.net/خرید-vpn
<
İnstagram takipçi satın al! İnstagram takipçi sitesi ile takipçi satın al sende sosyal medyada fenomen olmaya bir adım at. Sende hemen instagram takipçi satın almak istiyorsan tıkla:
ReplyDelete1- takipçi satın al
2- takipçi satın al
3- takipçi satın al
Very goood
ReplyDeletehttps://iransafe.net
Perde modelleri
ReplyDeletemobil onay
mobil ödeme bozdurma
nft nasıl alınır
ankara evden eve nakliyat
Trafik sigortası
DEDEKTÖR
kurma.website
Aşk kitapları
It is my first visit to your blog, and I am very impressed with the articles that you serve. Give adequate knowledge for me. Thank you for sharing useful material. I will be back for the more great post. 먹튀검증사이트 But by chance looking at your post solved my problem! I will leave my blog, so when would you like to visit it?!
ReplyDeletesmm panel
ReplyDeletesmm panel
Https://isilanlariblog.com/
İnstagram takipçi satın al
hirdavatciburada.com
Beyazesyateknikservisi.com.tr
SERVİS
tiktok jeton hilesi
ReplyDeleteI am very happy to read this article. Thanks for giving us Amazing info. Fantastic post.
Thanks For Sharing such an informative article, Im taking your feed also, Thanks.key ccleaner 5.21