How to tame cloud infrastructure sprawl with open source CloudQuery

Commentary: The cloud makes infrastructure sprawl simpler and worse than ever. This is an open supply device that will help you hold it in management.


Picture: skynesher/ Getty Photographs

The cloud has been a incredible boon to builders, however one of many soiled secrets and techniques of cloud is infrastructure sprawl. Builders, DevOps engineers and sysadmins battle with this day by day.

In the present day builders should create a bunch of customized scripts, write numerous code and keep these over time to grasp their infrastructure sprawl. Even when you simply use AWS, you possible have a number of accounts with no programmable option to do asset stock and automate queries.

Should-read developer content material

For instance, as an instance you utilize AWS and Okta. How do you get visibility into how they work collectively, what new sources are being created, how they’re linked and so forth? Your staff writes customized scripts and code. That is how.

A brand new open supply startup referred to as CloudQuery solves this drawback throughout a number of clouds in a developer-friendly strategy, counting on the favored SQL question language. CloudQuery simply introduced a $3.5 million seed spherical to assist speed up product and go-to-market improvement. In fact, on condition that it is open supply, corporations have already began utilizing CloudQuery to tame their infrastructure sprawl, together with Bloomberg, CloudBees, Zendesk and Salesforce.

SEE: Hiring package: Cloud engineer (TechRepublic Premium)

Open sourcing a repair for infrastructure sprawl

For Salesforce lead safety engineer Kinnaird McQuade, CloudQuery’s enchantment comes all the way down to elevated productiveness in much less time. “CloudQuery, which is comparatively new to the ecosystem, is one which I am notably enthusiastic about,” McQuade mentioned. “It might have saved me lots of time in earlier circumstances. The quantity of Python scripts that individuals needed to write to substitute a device like that is form of ridiculous. So I feel it will have an enormous future forward.”

CloudQuery solves the infrastructure visibility drawback by extracting away all of the configurations of your cloud environments and accounts. It transforms and normalizes that info in a relational database to offer builders visibility into each nook of their infrastructure and an automatic option to carry out orchestration with SQL as a substitute of code. There’s a big range of potential use circumstances, however most early adopters seem like utilizing it for safety and compliance.

CloudQuery took a web page from HashiCorp’s Terraform playbook, and it appears to be working. Whereas an imperfect measure, inside months after launch as open supply, CloudQuery already had greater than 1,000 stars on GitHub. That is maybe not stunning given the potential upside: The corporate claims that it will probably take as little as half an hour so as to add a cloud service supplier.

SEE: Energy guidelines: Native e-mail server-to-cloud migration (TechRepublic Premium)

“The enterprise cloud distributors present tooling, however they solely work within the context of that cloud,” mentioned Yevgeny Pats, founder and CEO of CloudQuery. “When you have got a number of instruments, builders need to bash them along with Python scripts. SQL has been round for 50 years, and it is one thing everybody is aware of by means of a be a part of and choose.”

Not that SQL is an ideal strategy. SQL’s major upside and draw back is that it has been round for therefore lengthy–it is not essentially fashionable, however it’s a well-known know-how. CloudQuery might finally help GraphQL or an alternate, non-relational question language, however the firm believes it is simpler for builders to construct once they have all their knowledge in a relational database reasonably than the opposite method round. 

And, lastly, open supply. For CloudQuery, open supply is not merely a advertising train, however reasonably a option to enhance the group across the challenge. Open supply not solely encourages integration contributions, it additionally permits greatest practices to be shared round managing infrastructure sprawl. 

Intrigued? Give CloudQuery a attempt.

Disclosure: I work for MongoDB, however the views expressed herein are mine.

Additionally see

Recent Articles


Related Stories

Leave A Reply

Please enter your comment!
Please enter your name here

Stay on op - Ge the daily news in your inbox