Posts Tagged 'IBM'

August 31, 2015

Data Ingestion and Access Using Object Storage

The massive growth in unstructured data (documents, images, videos, and so on) is one of the greatest problems facing today’s IT personnel. The challenge is storing all the data so that it and its storage solution can grow exponentially. Object storage is an ideal, cost-effective, scale-out solution for storing extensive amounts of unstructured data.

SoftLayer offers object storage based on the OpenStack Swift platform. Object storage provides a fully distributed, scalable, API-accessible storage platform that can be integrated directly into applications. It can be used for storing static data, such as virtual machine (VM) images, photos, emails, and so on. Click here for more information on object storage.

There are two important use cases when working with object storage: data ingestion and data access.

Data ingestion use case
A large medical research company needs to upload a large amount of data into their SoftLayer compute instance. The requirement is for a multi-hundred terabyte image repository that contains hundreds of millions of images. Researchers will then upload code to run on bare metal servers with GPUs to process the images in the repository. The images range from 512KB CT images to 30MB to 50 MB mammograms and are logically grouped into 12 million “studies.” The client wants to onboard the data as quickly as possible.

Recommendations

  • Evenly distribute the objects into approximately 1,000 containers for the initial upload. For the amount of objects the client needs to store, our tests have shown that having a much larger number of containers, or too few objects per container, would incur significant performance penalties. The proposed 1,000 containers allow for a good balance for parallelism in object creation and keeps the container sizes manageable.
  • Concurrently add new objects to all containers using 400 worker threads for small objects (e.g., 512KB CT images) and 40 worker threads for large objects (e.g., 30KB to 50KB mammograms). The ideal number of worker threads is dependent on the workload size. Using a minimal amount of threads results in better response but lower throughput. Using significantly more threads may lower both latency and throughput because the threads start competing for resources.

Data access use case
A large technology company has a mix of GET, PUT, and DELETE operations for which it needs object storage capable of holding billions of small objects (15KB or less). They also want consistent latencies for their operation mix (GET 54%, PUT 33%, and DELETE 13%), which requires optimal tuning for consistent performance. The client’s benchmarking calls for 1,400 operations per second.

Recommendations

  • Use multiple containers (at least 40) to improve the latency for PUT and DELETE objects. As long as the objects are distributed over at least 40 containers with a sufficient number of worker threads, the average latencies for PUT and DELETE objects was well below 100ms in our tests. There may be occasional latency spikes, which are not surprising on shared storage systems, but overall, the latencies should be relatively consistent.
    • Object reads (GETs) do not access containers. The read latency for a GET is very fast—less than 20ms on average for small objects.
  • Use multiple containers if very high throughput is needed. In our tests, we could drive more than 6,000 transactions per second on the production cluster with at least 40 containers. A shared production cluster has higher latencies than a dedicated environment, so more worker threads would be needed to achieve high throughput.

-Naeen Altaf & Khoa Huynh

Categories: 
August 11, 2015

The SLayer Standard Vol. 1, No. 14

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

We’re revving the IBM Cloud engine.
How is SoftLayer helping IBM’s cloud grow? Ed Scannell explores this in a new TechTarget article. He says many of the latest successes are “attributed to the IBM cloud unit's ability to respond faster to market opportunities, along with the ability to build corporate data centers significantly faster than IGS via SoftLayer.”

It’s time to turn to the cloud.
Across the industry, companies are seeing legacy software decreases. In a recent CBR article, James Nunns says he believes the solution could be in the cloud, and he highlights some of the transitions that IBM is making. Steve Robinson, IBM’s general manager of cloud platform services, says, "Today's rapid app development cycles require developers to use new tools and methodologies from across the ecosystem to quickly turn new ideas into enterprise-class cloud applications at consumer scale and innovate at the speed of cloud."

A case for both private and public cloud.
Are you still writing a pros and cons list to compare private and public cloud? It’s time to put the list away. IBMer Philip Guido explains, “Over the next five years, both public and private clouds are expected to grow at the exact same compound annual growth rate.” One thing to remember is that the choice of cloud model is “largely predicated by the business conditions of the industry a company is operating in.”

-Rachel

Categories: 
July 27, 2015

The SLayer Standard Vol. 1, No. 13

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

Growing Strong For Two Years
What has happened in the two years since SoftLayer joined forces with IBM? In a word: growth. Growth in several areas was spotlighted by 451 Research report. The article noted that SoftLayer is “no longer just an IaaS offer, but the foundation on which IBM is building strategic products. IBM Bluemix PaaS, data services and multiple SaaS offerings all run atop SoftLayer infrastructure.”

Welcome to The IBM Family
We’re excited to welcome Compose into our growing IBM brood. The acquisition was announced last week, but what does it bring the IBM family? Fortune highlights the company’s ability to “attract a new flock of web and mobile developers” to IBM, while offering up “lightweight database services based on MongoDB, Redis, Elasticsearch, PostgreSQL, RethinkDB and other databases.”

We’re Happy to Work With You
Core insurance technology software and IT services provider, Majesco, chose the IBM Cloud platform for its entire suite of property and casualty insurance software products to customers in a public cloud. In a write-up by IBR, Majesco’s COO Ed Ossie said, “Working with IBM will help insurers transform their business with a modern core solution that can be deployed on a proven and tested environment.”

A Chip Off The Old Block
IBM has designed the world’s smallest chip with the help of GLOBALFOUNDRIES and Samsung. Squint a bit and you might be able to see the 7 nm (yes, that’s a nanometer) chip that is the future of microprocessing.

In a statement, IBM called this new technology “crucial to meeting the anticipated demands of future cloud computing and Big Data systems, cognitive computing, mobile products, and other emerging technologies.”

-Rachel

Categories: 
May 12, 2015

The SLayer Standard Vol. 1, No. 12

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

We've got the power
What makes an existing partnership better? More power, of course. IBM and SAP strengthened the bond by adding a new set of integrated Power Systems solutions for SAP HANA in-memory computer applications: POWER8 servers. Welcome to a new era of high speed, high volume data processing.

Straight from the horse’s mouth
On the subject of IBM’s cloudy future, Forbes sat down with none other than Robert LeBlanc, SVP of IBM’s Cloud Business, to clear the haze. Ambition, AWS envy, and giving up on the public cloud? It’s all there.

Friending Facebook
If your company could target the right folks on Facebook, would it be interested? That’s what IBM’s latest ad partnership with the social network is all about. A write-up in Fast Company provides all the details behind the cooperative, which is aimed to "more accurately identify which of [a company’s] customers are among the 1.44 billion people active on Facebook.” After all, learning to leverage the social web just makes sense.

We’re so happy for you
When big things happen for our customers, we love to highlight them. Longtime IBM business partner Manhattan Associates chose IBM Cloud as a preferred cloud provider for its clients (which includes tech support for those running their applications on SoftLayer). And Distribution Central is now offering its 1,000 resellers access to AWS, Azure and IBM Cloud’s SoftLayer cloud services through a single interface. Way to go, everyone.

No autographs, please!
Oh, and it’s come to our attention that we were mentioned on the latest episode of HBO’s Silicon Valley. Although the scenario in which we were mentioned wasn't quite factually accurate, being famous looks good on us, if we do say so ourselves. Now if you’ll excuse us, we’re going to inquire into our star on the Hollywood Walk of Fame.

-Fayza

Categories: 
April 29, 2015

The SLayer Standard Vol. 1, No. 11

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

Q1
A recent study deemed SoftLayer the top-mentioned hosting provider for cloud services among 50 percent of IT decision makers. This news comes on the heels of IBM’s first quarter earnings report, announcing a 75 percent increase in cloud revenue (with yearly revenue at $7.7 billion). Forbes explains IBM’s rise to power over the competition in “Move Over Amazon, IBM Can Also Claim Top Spot In Cloud Services.” Additionally, Mark Jones, SoftLayer’s chief technology officer, gave details to CRN on how IBM expects to stay on top of the cloud competition by offering pricing benefits over its market-leading rivals.

SoftLayer opens data center in The Netherlands…again.
Last week, in an effort to continue delivering on our promise to expand data centers worldwide, SoftLayer opened a second data center in the Netherlands—just outside Amsterdam in Almere. “The new facility demonstrates the demand and success IBM Cloud is having at delivering high-value services right to the doorstep of our clients,” said James Comfort, IBM cloud services general manager.

Building Applications in the Cloud with SoftLayer
For those who enjoy broadcast over print, our lead technology evangelist, Phil Jackson, sat down with Jacob Goldstein of Wireframes to discuss how to choose the right servers for your needs. Listen to the podcast.

-JRL

Categories: 
April 24, 2015

Working Well With Your Employees

In the past 17 years I’ve worked in a clean-room laboratory environment as an in-house tech support person managing windows machines around dangerous lasers and chemicals, in the telecommunications industry as a systems analyst and software engineer, and in the hosting industry as a lead developer, software architect, and manager of development. In every case, the following guiding principles have served me well, both as an employee striving to learn more and be a better contributor and as a manager striving to be a worthy employer of rising talent. Whether you are a manager or a startup CEO, this advice will help you cultivate success for you and your employees.

Hire up.
When you’re starting out, you will likely wear many hats out of necessity, but as your company grows, these hats need to be given to others. Hire the best talent you can, and rely on their expertise. Don’t be intimidated by intelligence—embrace it and don’t let your ego stand in the way. Also, be aware that faulty assumptions about someone’s skill set can throw off deadlines and cause support issues down the road. Empowering people increases a sense of ownership and pride in one’s work.

Stay curious.
IBM has reinvented itself over and over. It has done this to keep up with the ever-changing industry with the help of curious employees. Curious people ask more questions, dig deeper, and they find creative solutions to current industry needs. Don’t pour cold water on your employees who want to do things differently. Listen to them with an open mind. Change is sometimes required, and it comes through innovation by curious people.

Integrate and automate everything.
Take a cue from SoftLayer: If you find yourself performing a repetitive task, automate and document it. We’ve focused on automation since day one. Not only do we automate server provisioning, but we’ve also automated our development build processes so that we can achieve repeatable success in code releases. Do your best to automate yourself out of a job and encourage others to live by this mantra. Don’t trade efficiency for job security—those who excel in this should be given more responsibility.

Peace of mind is worth a lot.
Once a coworker and I applied to contract for a job internally because our company was about to spend millions farming it out to a third party. We knew we could do it faster and cheaper, but the company went with the third party instead. Losing that contract taught me that companies are willing to pay handsomely for peace of mind. If you can build a team that is that source of that peace of mind for your company, you will go far.

When things don’t go right.
Sometimes things go off the rails, and there’s nothing you can do about it. People make mistakes. Deadlines are missed. Contracts fall through. In these situations, it’s important to focus on where the process went wrong and put changes in place to keep it from happening again. This is more beneficial to your team than finger pointing. If you can learn from your mistakes, you will create an environment that is agile and successful.

- Jason

April 20, 2015

The SLayer Standard Vol. 1, No. 10

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

The Battle for Global Market Share
Warmer weather must be around the corner—or it could just be the cloud industry heating up. How will cloud providers profit as more and more providers push for world domination? The Economist predicts an industry change as prices drop.

IBM Partners with TI on Secure APIs for IoT
Allow me to translate: the International Business Machines Corporation is partnering with Texas Instruments to secure application program interfaces with the help of the Internet of Things. Through its collaboration with TI, IBM will create a Secure Registry Service that will provide trust and authentication practices and protocol across the value chain–from silicon embedded in devices and products to businesses and homes.

(Join the conversation at #IoTNow or #IoT.)

The U.S. Army Goes Hybrid
The U.S. Army is hoping to see a 50 percent cost savings by utilizing IBM cloud services and products. Like many customers, the Army opted for a hybrid solution for security, flexibility, and ease of scale. Read more about what IBM Cloud and SoftLayer are doing for the U.S Army and other U.S. government departments.

The Only Constant is Change
Or so said Heraclitus of Ephesus. And to keep up with the changing times, IBM has reinvented itself over and over again to stay relevant and successful. This interesting read discusses why big corporations just aren't what they used to be, what major factors have transformed the IT industry over the last couple of decades, and how IBM has been leading the change, time-after-time.

-JRL

Categories: 
April 10, 2015

The SLayer Standard Vol. 1, No. 9

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

Welcome to the Masters
If you’re not practicing your swing this weekend, you’re watching the Masters. Over the next couple of days, professional golfers will seek their shot at landing the coveted Green Jacket. And while everyone might be watching the leaderboard, IBM will be hard at work in what they are calling the “bunker,” located in a small green building at the Augusta National Golf Club.

What does IBM have to do with the Masters? Everything.

Read how IBM, backed by the power of the SoftLayer cloud, is making the Masters website virtually uncrashable.

And for those that can’t line the greens to watch your favorite player, IBM is utilizing the lasers the Golf Club has placed around the course to track the ball as it flies from hole-to-hole. Learn more about the golf-ball tracking technology here.

Open Happiness
In a move to streamline tech operations and cut costs, Coca-Cola Amatil is partnering with IBM Cloud to move some of its platforms to SoftLayer data centers in Sydney and Melbourne—a deal sure to open happiness.

"The move to SoftLayer will provide us with a game-changing level of flexibility, resiliency and reliability to ramp up and down capacity as needed. It will also remove the need for large expenditure on IT infrastructure." - Barry Simpson, CIO, Coca-Cola Amatil

Read more about the new CCA cloud environment and the five-year, multimillion-dollar deal.

-JRL

Categories: 
April 1, 2015

The SLayer Standard Vol. 1 No. 8

The week in review. All the IBM Cloud and SoftLayer headlines in one place.

Sunny Skies for IBM Cloud and The Weather Company
IBM made big headlines on Tuesday when it announced they would team up with The Weather Company boasting “100 percent chance of smarter business forecasts.”

Bloomberg sits down with Bob Picciano, IBM Analytics Senior VP, and David Kenny, The Weather Company CEO to discuss what makes this different than other companies that have analyzed the weather in the past. Using Watson Analytics and the Internet of Things, the partnership will transform business decision-making based on weather behavior. Read how IBM’s $3 billion investment in the Internet of Things will collect weather data from 100,000 weather stations around the world and turn it into meaningful data for business owners.

Indian Startups Choose SoftLayer
According to the National Association of Software and Services Companies (NASSCOM), India has the world’s third largest and the fastest-growing startup ecosystem. Like many SoftLayer startup customers, Goldstar Healthcare, Vtiger, Clematix, Ecoziee Marketing utilize the SoftLayer cloud infrastructure platform to “begin on a small scale and then expand rapidly to meet workload demands without having to worry about large investments in infrastructure development.”

New SoftLayer Storage Offerings
Last week, SoftLayer announced the launch of block storage and file storage complete with Endurance- and Performance-class tiers. The media was fast to report the new offerings that provide customers more choice, flexibility, and control for their storage needs and workloads.

“ … SoftLayer’s focus on tailored capacity and performance needs coincides with the trend in the cloud market of customizing technology based on different application requirements.”– IBM Splits SoftLayer Cloud Storage Into Endurance, Performance Tiers

“In the age of the cloud, the relationship between cloud storage capacity and I/O performance has officially become divorced.” – IBM Falls Into Cloud Storage Pricing Line

Pick your favorite online tech media and read all about it: SiliconANGLE, Computer Weekly, Data Center Knowledge, CRN, V3, Cloud Computing Intelligence, Storage Networking Solutions UK, and DCS Europe.

#IBMandTwitter
There are more than half a billion tweets posted to Twitter every day. IBM is teaming up with Twitter to turn those “tweets into insights for more than 100 organizations around the world.” Leon Sun of The Motley Fool takes a closer look at what the deal means to IBM and Twitter.

“Twitter provides a powerful new lens through which to look at the world. This partnership, drawing on IBM’s leading cloud-based analytics platform, will help clients enrich business decisions with an entirely new class of data. This is the latest example of how IBM is reimaging work.” – Ginni Romety, IBM Chairman, President and CEO

-JRL

Categories: 
March 6, 2015

The SLayer Standard Vol. 1 No. 7: the IBM InterConnect Edition

Last week, an estimated 21,000 IBMers, SLayers, customers and partners from around the world flooded Las Vegas, Nev. to attend the first-ever IBM InterConnect. This new conference combined three popular IBM conferences (Impact, Innovate and Pulse) into a single, premier cloud and mobile techno-topia.

What our engineers and developers did in Las Vegas after conference hours might have stayed in Las Vegas, but IBM’s InterConnect hits and announcements didn’t. Here’s a recap:

Speed to Market Wins the Cloud Computing Race
Everyone likes to go fast, and the new senior vice president for IBM Cloud, Robert LeBlanc, likes to go super-fast. “What I’m focusing on is speed,” LeBlanc says.

In this blink-and-the-market-changes world, time-to-market determines the winners and losers in cloud computing. Part of LeBlanc’s strategy is opening new SoftLayer datacenters. If you haven’t heard the news, SoftLayer will be launching Sydney and Montreal data centers in the next 30 days — with more coming soon. Stay tuned for more locations.

Read more on how LeBlanc plans to win the cloud business race.

Cloudy skies on the horizon—that’s a good thing!
Our CEO, Ginni Rometty, announced a $4 billion investment on cloud services (shared with the data analytics and mobile businesses). She’s hoping that the investment will spur $40 billion a year in revenue come 2018.

Signs of the investment could be seen as execs at InterConnect announced new hybrid services coming in 2015, including enterprise containers. [What’s a container? Read our blog post.]

In fact, hybrid was a big theme at InterConnect. “We are going to make all those clouds act like one,” says Angel Diaz, vice president of IBM cloud technologies. IBM cloud (powered by SoftLayer) will be a one-stop shop: a cloud superstore with a smorgasbord of aaS offerings.

It looks like it’ll be an exciting ride for IBM over the next couple of years. Make sure to keep up with the headlines for more announcements in the coming months.

-JRL

Categories: 
Subscribe to ibm