Turbotodd

Ruminations on tech, the digital media, and some golf thrown in for good measure.

Posts Tagged ‘big data

IBM Acquires UrbanCode For Rapid Delivery Of Mobile, Cloud, Big Data & Social Software

leave a comment »

IBM today announced it has acquired UrbanCode Inc.

Based in Cleveland, Ohio, UrbanCode automates the delivery of software, helping businesses quickly release and update mobile, social, big data, cloud applications.

Mobile, social, big data and cloud technologies are driving demand for new, faster and more frequent approaches to software delivery. Waiting days or even months to get an update to clients is no longer acceptable.

With UrbanCode’s technology, businesses can reduce the cycle time it takes to get updates or new applications into market, from months to minutes. This approach is designed to help reduce cost and risk, while helping address changing client needs by enabling a company to rapidly incorporate feedback into and improve the overall quality of their applications and services.

Software Development As Competitive Advantage

A recent study by the IBM Institute for Business Value uncovered that almost 70 percent of companies using software development for competitive advantage outperform their peers in profitability. As innovation in software becomes more and more critical to success, businesses need a collaborative, intuitive and continual approach to development, testing and delivery.

More than half of surveyed companies agree effective software development is crucial to competitive advantage. Yet, only a quarter of companies feel they have effective methods. UrbanCode’s capabilities will help solve this execution gap with the ability to accelerate software delivery.

IBM plans to continue to support UrbanCode clients and enhance their technologies while allowing these organizations to take advantage of the broader IBM portfolio.

UrbanCode’s software is a natural extension of IBM’s DevOps strategy, designed to simplify and speed the entire software development and delivery process for businesses.

The new capabilities also enhance IBM SmartCloud and IBM MobileFirst initiatives by making it easier and faster for clients to deliver software through those channels. For example, by combining UrbanCode software with the IBM MobileFirst Worklight technology, businesses can now author and deploy an application for any mobile device in hours, versus a previous multi-day timeline.

The UrbanCode solution also works with traditional applications including middleware, databases and business intelligence.

“Companies that master effective software development and delivery in rapidly changing environments such as cloud, mobile and social will have a significant competitive advantage,” said Kristof Kloeckner, general manager, IBM Rational Software. “With the acquisition of UrbanCode, IBM is uniquely positioned to help businesses from every industry accelerate delivery of their products and services to better meet client demands.”  

“Together UrbanCode and IBM technology will be unmatched in the industry, providing businesses a continuous process for developing, testing, and delivering new and updated software,” said Maciej Zawadzki, chief executive officer, UrbanCode. “By removing the bottlenecks that traditionally exist between development teams and production systems, businesses can drive rapid innovation.”

For more information visit the IBM Rational site.

Big Moves In Big Data: IBM New Data Acceleration, Hadoop Capabilities

with one comment

IBM just announced new technologies designed to help companies and governments tackle Big Data by making it simpler, faster and more economical to analyze massive amounts of data. New data acceleration innovation results in as much as 25 times faster reporting and analytics.

Click to enlarge. IBM just announced new technologies designed to help companies and governments tackle Big Data by making it simpler, faster and more economical to analyze massive amounts of data. New data acceleration innovation results in as much as 25 times faster reporting and analytics.

IBM made a significant announcement earlier today concerning new technologies designed to help companies and governments tackle Big Data by making it simpler, faster and more economical to analyze massive amounts of data. The new data acceleration innovation results in as much as 25 times faster reporting and analytics.

Today’s announcement, which represents the work of hundreds of IBM developers and researchers in labs around the world, includes an industry-first innovation called “BLU Acceleration,” which combines a number of techniques to dramatically improve analytical performance and simplify administration.

Also announced was the new IBM PureData System for Hadoop, designed to make it easier and faster to deploy Hadoop in the enterprise. Hadoop is the game-changing open-source software used to organize and analyze vast amounts of structured and unstructured data, such as posts to social media sites, digital pictures and videos, online transaction records, and cell phone location data.

The new system can reduce from weeks to minutes the ramp-up time organizations need to adopt enterprise-class Hadoop technology with powerful, easy-to-use analytic tools and visualization for both business analysts and data scientists.

In addition, it provides enhanced Big Data tools for monitoring, development and integration with many more enterprise systems.

IBM Big Data Innovations: More Accessible, Enterprise-ready 

As organizations grapple with a flood of structured and unstructured data generated by computers, mobile devices, sensors and social networks, they’re under unprecedented pressure to analyze much more data at faster speeds and at lower costs to help deepen customer relationships, prevent threat and fraud, and identify new revenue opportunities.

BLU Acceleration enables users to have much faster access to key information, leading to better decision-making. The software extends the capabilities of traditional in-memory systems — which allows data to be loaded into Random Access Memory instead of hard disks for faster performance — by providing in-memory performance even when data sets exceed the size of the memory.

During testing, some queries in a typical analytics workload were more than 1000 times faster when using the combined innovations of BLU Acceleration.

Innovations in BLU Acceleration include “data skipping,” which allows the ability to skip over data that doesn’t need to be analyzed, such as duplicate information; the ability to analyze data in parallel across different processors; and greater ability to analyze data transparently to the application, without the need to develop a separate layer of data modeling.

Another industry-first advance in BLU Acceleration is called “actionable compression,” where data no longer has to be decompressed to be analyzed.

Not IBM’s First Big Data Rodeo

The new offerings expand what is already the industry’s deepest portfolio of Big Data technologies and solutions, spanning software, services, research and hardware. The IBM Big Data platform combines traditional data warehouse technologies with new Big Data techniques, such as Hadoop, stream computing, data exploration, analytics and enterprise integration, to create an integrated solution to address these critical needs.

IBM PureData System for Hadoop is the next step forward in IBM’s overall strategy to deliver a family of systems with built-in expertise that leverages its decades of experience reducing the cost and complexity associated with information technology.

This new system integrates IBM InfoSphere BigInsights, which allows companies of all sizes to cost-effectively manage and analyze data and add administrative, workflow, provisioning and security features, along with best-in-class analytical capabilities from IBM Research.

Today’s announcement also includes the following new versions of IBMs Big Data solutions:

  • A new version of InfoSphere BigInsights, IBM’s enterprise-ready Hadoop offering, which makes it simpler to develop applications using existing SQL skills, compliance security and high availability features vital for enterprise applications. BigInsights offers three entry points: free download, enterprise software and now an expert integrated system, IBM PureData System for Hadoop.
  • A new version of InfoSphere Streams, unique “stream computing” software that enables massive amounts of data in motion to be analyzed in real-time, with performance improvements, and simplified application development and deployment.
  •  A new version of Informix including TimeSeries Acceleration for operational reporting and analytics on smart meter and sensor data.

Pricing and Availability 

All offerings are available in Q2, except the PureData System for Hadoop, which will start shipping to customers in the second half 2013. Credit-qualified clients can take advantage of simple, flexible lease and loan packages with no up-front payments for the software and systems that deliver a new generation of data analytics.

IBM Global Financing offers attractive leasing programs with 90-day payment deferrals for the PureData System for Hadoop, as well as zero percent loans for the broader portfolio of IBM big data solutions.

IBM Opens Lab To Bring R&D To The CEO

leave a comment »

One of the things we heard about extensively during our time on the ground at SXSW Interactive 2013 in Austin over the past week was the importance of the customer experience.

Whether that be in applications in mobile devices, in customer service via the social media, the physical experience of a brand’s product or service…the customer experience rules!

And this anecdotal data is supported by IBM’s own research, including last year’s Global CEO Study, which queried 1,700 CEOs from 64 countries and 18 industries and found that CEOs are changing the nature of work by adding a powerful dose of openness, transparency, and employee empowerment to the command-and-control ethos that has characterized the modern corporation for more than a century.

The study revealed that the advantages of this fast-moving trend are clear: Companies that outperform their peers are 30 percent more likely to identify openness — often characterized by a greater use of social media as a key enabler of collaboration and innovation — as a key influence on their organization.

Those “outperformers” are also embracing new models of working that tap into the collective intelligence of an organization and its networks to devise new ideas and solutions for increased profitability and growth.

In order to forge those closer connections with customers, partners, and a new generation of employees in the future, CEOs plan to shift their focus from using e-mail and the phone as primary communication vehicles to using social networks as a new path for direct engagement. And while social media is the least utilized of all customer interaction methods today, it stands to become the number two organizational engagement method within the next five years, a close second to face-to-face interactions.

Big Data, Big Opportunity

Given the data explosion being witnessed by many organizations, CEOs also recognized the need for more sophisticated business analytics to mine the data being tracked online, on mobile phones and social media sites. The traditional approach to understanding customers better has been to consolidate and analyze transactions and activities from across the entire organization. However, to remain relevant, CEOs must piece together a more holistic view of the customer based on how he or she engages the rest of the world, not just their organization.

The ability to drive value from data is strongly correlated with performance. Outperforming organizations are twice as good as underperformers at accessing and drawing insights from data. Outperformers are also 84 percent better at translating those insights into real action.

From Theory to Action

To this end, IBM today announced the creation of the IBM Customer Experience Lab, dedicated to helping business leaders transform the way customers experience their products, services and brands through the use of mobile, social, cloud and advanced analytics technologies.

IBM Research scientists and business consultants will co-create with clients to deliver systems that learn and personalize the experiences of each individual customer, identify patterns, preferences and create context from Big Data, and drive scale economics.

The IBM Customer Experience Lab will provide CEOs, CMOs, CFOs, heads of sales and other C-suite executives direct access to a virtual team of 100 researchers, supported by the deep industry and domain expertise of thousands of IBM business consultants addressing the opportunities of the digital front office.

In the new age of Big Data and analytics, organizations are reassessing how to move from addressing mass audiences to personalized relationships. The same technologies allow enterprises to engage in new ways with their employees, allow government agencies to build new relationships with citizens, or enable new models of interaction among students and educational institutions.

IBM Research is developing technology assets and capabilities that can help deliver front office capabilities as a service from a cloud, design novel products to match customer preferences, and leverage math and psychological theories of personality to improve marketing effectiveness.
Client Engagements

The Lab focuses on innovation breakthroughs in three primary areas:

  • Customer insight. Applying advanced capabilities such as machine learning and visual analytics to predict differences in individual customer behavior across multiple channels.
  • Customer engagement. Using deep customer engagement to drive insight and continuously deliver value by personalizing engagement, versus transactional experiences.
  • Employee engagement. Embedding semantic, collaborative, and multimedia technologies to foster employee engagement and insight – in person and online.

Among the clients engaged with IBM on advancing their innovation process are Nationwide Building Society, the world’s largest building society serving 15 million members in the United Kingdom, and Banorte, one of the largest banks in Mexico with more than 20 million customers.

“Mobile and social technologies, and the ability to access information anytime, anywhere, is driving significant change in the way consumers bank and in the services they expect,” said Martin Boyle, Divisional Director of Transformation, Nationwide Building Society. “Our ability to innovate and anticipate, and not just respond, is what sets us apart from the competition and helps us to provide our customers with new and better ways to do business with us. By partnering with IBM, we can tap into its vast research and innovation expertise and facilities, which has already proved invaluable in our transformation program and will continue to be an important part in how we continue to innovate our service for customers.”

New Tools and Capabilities

The Lab provides IBM clients with an innovation process, assets and platform to give line of business leaders the exclusive ability to work side-by-side with IBM researchers and business consultants to analyze business challenges and jointly create solutions that integrate next-generation mobile, social, analytics and cloud technologies.

Co-creation with clients includes an innovation model called Innovation Discovery Workshops, which generate ideas, roadmaps, prototypes and solutions that draw on research assets, business consulting and IBM Software solutions in areas such as Smarter Commerce, Big Data, analytics, and Mobile First products.

The IBM Customer Experience Lab will be headquartered at the Thomas J. Watson Research Center in Yorktown Heights, N.Y., supported by researchers at IBM’s 12 global labs including Africa, Brazil, California, China, India, Israel, Japan, Switzerland, and Texas.

The Lab brings together skills across disciplines including service science, industries research, mathematics and business optimization, social, mobile, Smarter Commerce, data mining, cloud computing, security and privacy, cognitive computing and systems management. IBM invests more than $6 billion annually on research and development and employs about 3,000 researchers worldwide. IBM Global Business Services deploys business consulting, applications and delivery expertise globally, including market-leading business analytics, Smarter Commerce, mobility and applications management practices.

Visit here for more information about the IBM Customer Experience Lab, and follow IBM’s innovation breakthroughs on Twitter at @IBMResearch.

Online Retailer LabelSneak Leverages IBM Smarter Commerce Technologies To Glean Mobile/Social Insights, Bolster Sales

with one comment

LabelSneak teamed with IBM and IBM Business Partner CSI Solution to connect with the growing marketplace of consumers who prefer to buy across online, mobile and social channels. IBM Smarter Commerce precision marketing is allowing consumers to choose which sales promotions they want to be alerted to or when their favorite clothing item goes on sale via text, tweet, Facebook post or email. This can be a more effective sales method as smaller retailers can deliver a level of personalization and a more tailored marketing campaign to the individual consumer.

LabelSneak teamed with IBM and IBM Business Partner CSI Solution to connect with the growing marketplace of consumers who prefer to buy across online, mobile and social channels. IBM Smarter Commerce precision marketing is allowing consumers to choose which sales promotions they want to be alerted to or when their favorite clothing item goes on sale via text, tweet, Facebook post or email. This can be a more effective sales method as smaller retailers can deliver a level of personalization and a more tailored marketing campaign to the individual consumer.

There’s some new news on the Smarter Commerce front from IBM.

Earlier today, IBM announced a collaboration with LabelSneak, a small online retailer of discounted designer men’s wear, which is using IBM Smarter Commerce technologies to create a unique shopping experience aimed at the millennial consumer.

As a result, LabelSneak has seen 148 percent growth in revenues, tripling sales in less than a year.

For The Fashion Conscious Male

LabelSneak is an outlet store aimed at brand aware males, and offers discounts of up to 75 percent on fashion and sportswear, alerting its consumers via social channels to personalized, limited-time sales offers.

With new deals updated regularly, the site generates tremendous amounts of data, including Tweets, Instagram photos, Facebook comments on popular sales items and conversations between consumers on favorite brands through social channels, mobile and tablet devices.

LabelSneak’s challenge was this: To capture and glean insights from all this big data to better understand what consumers were saying about the latest promotions, which items were the most popular and at what time and in what circumstances sales were most effective.

They also needed analytics to better target and mold online sales campaigns and to decide which social channels effectively communicated its message to attract new customers.

LabelSneak teamed with IBM and IBM Business Partner CSI Solution to connect with the growing marketplace of consumers who prefer to buy across online, mobile and social channels.

With access to IBM Global Financing within minutes, the small retailer is now using IBM Smarter Commerce technology to handle high volumes of transactions as well as the large volumes and variety of data, CSI’s RapidCommerce Cloud Managed Service Solution has helped LabelSneak create a site to more effectively target the digitally savvy millennial consumer with an integrated brand experience across all devices.

To date, the platform is supporting a rapid pace of growth, enabling the client to focus its time and resources on growing the business such as conducting sales promotions, gleaning insights from Facebook comments or tweets.

The Competitive Challenge

Fashion companies of every size and style are vying for a slice of the men’s wear market. To compete with more established retailer brands, LabelSneak needed to better understand men’s online consumer behavior, create a more tailored marketing campaign and deliver the right merchandising mix.

Not only is LabelSneak gleaning insights from data analyzing which brands to carry, but they also are seeing how consumer preferences for certain brands in men’s wear are connected to a favorite sports teams or music.

Background On IBM Smarter Commerce

IBM Smarter Commerce precision marketing is allowing consumers to choose which sales promotions they want to be alerted to or when their favorite clothing item goes on sale via text, tweet, Facebook post or email.

This can be a more effective sales method as smaller retailers can deliver a level of personalization and a more tailored marketing campaign to the individual consumer.

IBM Smarter Commerce provides intelligent automation of marketing, sales, customer service and procurement to help chief marketing officers, chief procurement officers, sales, e-commerce, supply chain and customer service executives do their jobs more productively and efficiently.

Go here if you’d like to do some shopping on LabelSneak.

Blue Water

leave a comment »

Population growth, massive urbanization and climate change are placing increasing demands on our limited water supply. Forty one percent of the world’s population – that’s 2.3 billion people – live in water-stressed areas; this number is expected to grow to 3.5 billion by 2025.

And according to the United Nations, water use has been growing at more than twice the rate of population increase over the last century.

With advances in technology — deep computing and Big Data analytics linked to sophisticated sensor networks and smart meters — IBM is helping clients and partners make smarter decisions about water management.

By monitoring, measuring and analyzing water systems, from rivers and reservoirs to pumps and pipes, we can better understand the issues around water.  IBM is applying its expertise in smart systems and Big Data to help companies, governments and citizens understand and more effectively deal with these issues.

Waterfund LLC announced today that it has signed an agreement with IBM to develop a Water Cost Index (WCI).

Scientists from IBM Research will apply Big Data expertise, acting as a calculation agent, to analyze large and diverse unstructured data sets. This will be used to develop of a WCI framework that would estimate the cost of water in different regions around the world. With its market and financial product expertise, Waterfund will work to structure and commercialize the WCI.

Discerning The Real Cost Of Water

As governments are increasingly forced to turn to the private sector to fund the construction and maintenance of complex water networks, the Rickards Real Cost Water Index™ will serve as a benchmark for helping measure hundreds of critical projects on a like-for-like basis.

Index values will reflect estimated water production costs measured in US dollars per cubic metre for a variety of major global water infrastructure projects ranging from retail water utilities and wholesale water utilities to major transmission projects.

“The backlog of investment in water systems around the world by some estimates approaches $1 trillion – quite apart from the hundreds of millions of people who have never had access to a water or sanitation system at all,” said IBM Distinguished Engineer and Big Green Innovations CTO Peter Williams.

“By creating a benchmark cost for water we intend to harness the capital market to this supremely important cause. If we can make it easier to price investments in the water sector, we can improve the flow of capital into an area where it is desperately needed. We look forward to working with Waterfund to bring this about.”

Scott Rickards, President & CEO of Waterfund said, “The principal reason behind our decision to work with IBM was their unique combination of expertise in the water sector combined with the best data analytics available. Our initiative with IBM will finally bring real financial transparency to the water sector. By calculating the unsubsidized cost of freshwater production using IBM’s Big Data expertise, Waterfund can offer the first flexibly-tailored financial tools to investors in water infrastructure. The Rickards Real Cost Water Index™ highlights the energy costs, interest rate risk, and capital expenditures required to build and maintain large-scale water treatment and delivery networks.”

Smarter Water Management Examples

Typically, investors have turned to the public equity markets to gain exposure to the water sector, with mixed results. The WCI is intended to provide a market benchmark and to spur the development of third-generation financial products for both water producers and investors and to aid the growth of the water sector globally.

Here are two examples of how it would work:

Scenario 1: A Water Agency cannot obtain bank financing for Phase 2 of a seawater desalination plant project due to previous cost overruns on Phase

1. Yet the Agency lacks the water it needs to supply a contractually specified daily volume of water to its largest customer, with a consequent risk of large penalties for each day of insufficient volume. Using strike and trigger values based on the WCI, the Water Agency could purchase a $25 million, 2 year insurance product.

Payout to the Water Agency would be triggered on the total change in its Water Cost Index (as well as some other conditions, such as a specified increase in asset failure costs).  This approach would enable the Water Agency to enhance its overall credit profile with the insurance enabled by the WCI, finance Phase 2 of the desalination plant and meet its supply obligations.

Scenario 2: A large desalination and water transmission system project needs to secure private equity and institutional funding alongside that from development banks and sovereign funds, to the tune of one third of the total project cost. To achieve this, the project needs a way to reduce risk to its investors.

Based on movement in the WCI, the project could purchase $50 million in insurance. This would enable the insurance product to then be underwritten by a large reinsurer and allow the project to secure the private sector contribution it needs in order to proceed.

Go here to learn more about IBM Smarter Water Management initiatives.  You can also go here to register for a report IBM prepared on why we need smarter water management for our world’s most precious resource.

IBM To Acquired StoredIQ

leave a comment »

IBM today announced it has entered into a definitive agreement to acquire StoredIQ Inc., a privately held company based in Austin, Texas.

Financial terms of the deal were not disclosed.

StoredIQ will advance IBM’s efforts to help clients derive value from big data and respond more efficiently to litigation and regulations, dispose of information that has outlived its purpose and lower data storage costs.

With this agreement, IBM adds to its prior investments in Information Lifecycle Governance. The addition of StoredIQ capabilities enables clients to find and use unstructured information of value, respond more efficiently to litigation and regulatory events and lower information costs as data ages.

IBM’s Information Lifecycle Governance suite improves information economics by helping companies lower the total cost of managing data while increasing the value derived from it by:

  • Eliminating unnecessary cost and risk with defensible disposal of unneeded data
  • Enabling businesses to realize the full value of information as it ages
  • Aligning cost to the value of information
  • Reducing information risk by automating privacy, e-discovery, and regulatory policies

Adding StoredIQ to IBM’s Information Lifecycle Governance suite gives organizations more effective governance of the vast majority of data, including efficient electronic discovery and its timely disposal, to eliminate unnecessary data that consumes infrastructure and elevates risk.

As a result, business leaders can access and analyze big data to gain insights for better decision-making. Legal teams can mitigate risk by meeting e-discovery obligations more effectively. Also, IT departments can dispose of unnecessary data and align information cost to value to take out excess costs.

What Does StoredIQ Software Do? 

StoredIQ software provides scalable analysis and governance of disparate and distributed email as well as file shares and collaboration sites. This includes the ability to discover, analyze, monitor, retain, collect, de-duplicate and dispose of data.

In addition, StoredIQ can rapidly analyze high volumes of unstructured data and automatically dispose of files and emails in compliance with regulatory requirements.

StoredIQ brings powerful, innovative capabilities to govern data in place to drive value up and cost out.

StoredIQ brings powerful, innovative capabilities to govern data in place to drive value up and cost out.

“CIOs and general counsels are overwhelmed by volumes of information that exceed their budgets and their capacity to meet legal requirements,” said Deidre Paknad, vice president of Information Lifecycle Governance at IBM. “With this acquisition, IBM adds to its unique strengths as a provider able to help CIOs and attorneys rapidly drive out excess information cost and mitigate legal risks while improving information utility for the business.”

Named a 2012 Cool Vendor by Gartner, StoredIQ has more than 120 customers worldwide, including global leaders in financial services, healthcare, government, manufacturing and other sectors. Other systems require months to index data and years to configure, install and address information governance. StoredIQ can be up and running in just hours, immediately helping clients drive out cost and risk.

IBM intends to incorporate StoredIQ into its Software Group and its Information Lifecycle Governance business.

Building on prior acquisitions of PSS Systems in 2010 and Vivisimo in 2012, IBM adds to its strength in rapid discovery, effective governance and timely disposal of data.  The acquisition of StoredIQ is subject to customary closing conditions and is expected to close in the first quarter of 2013.

Go here for more information on IBM’s Information Lifecycle Governance suite, and here for more information on IBM’s big data platform.

CMO Talk: What If Everything You Knew About Marketing Changed?

with 2 comments

Click to enlarge. The practice of marketing is going through a period of unparalleled change, putting CMOs everywhere to the test. However, you can seize the opportunity to transform your marketing function. The combined insights of the 1,734 senior marketing executives participating in IBM’s Global CMO study point to three strategic imperatives that can strengthen your likelihood of success, as outlined in the graphic above.

Contrary to popular opinion, we don’t all know one another at IBM.

I know, I know, it’s hard to believe, considering there’s only 400,000+ plus of us — you’d think we all knew one another, but we don’t.

But the good news is, we’re always making new acquaintances inside IBM.

That was the case at the Word of Mouth Marketing Association Summit I attended last week in Vegas, where I finally got to meet face-to-face my colleague, Carolyn Heller Baird.

Carolyn is situated in IBM’s Global Business Services organization, and for the better part of two years, Carolyn served as the Global Director for our Chief Marketing Officer study, which was released late last year (and for which I wrote an extensive blog post, which you can find here.)

Carolyn was also in attendance at WOMMA, where she presented the CMO findings in some detail before a sizable audience.

I sat down with Carolyn to talk about the study’s findings in more detail, and to also try and better understand the implications for marketers in general, and social media practitioners in specific.

Before I hand you off to our interview below, I want to highlight the fact that the study results are still available via download here.

As the study concluded, half of all CMOs today feel insufficiently prepared to provide hard numbers for marketing ROI, even as they expect that by 2015, return on marketing investment will be the primary measure of the marketing function’s effectiveness.

There’s a gap to close there, and Carolyn’s comments in the video provide some actionable insights on to how to start to close it!

The Vindication Of Nate Silver

leave a comment »

I was all set to write a closer examination of statistician and blogger Nate Silver’s most recent election predictions, a ramp up to during which he was lambasted by a garden variety of mostly conservative voices for either being politically biased, or establishing his predictions on a loose set of statistical shingles.

Only to be informed that one of my esteemed colleagues, David Pittman, had already written such a compendium post.  So hey, why reinvent the Big Data prediction wheel?

Here’s a link to David’s fine post, which I encourage you to check out if you want to get a sense of how electoral predictions provide an excellent object lesson for the state of Big Data analysis. (David’s post also includes the on-camera interview that Scott Laningham and I conducted with Nate Silver just prior to his excellent keynote before the gathered IBM Information On Demand 2012 crowd.)

I’m also incorporating a handful of other stories I have run across that I think do a good job of helping people better understand the inflection point for data-driven forecasting that Silver’s recent endeavor represents, along with its broader impact in media and punditry.

They are as follows:

 “Nate Silver’s Big Data Lessons for the Enterprise”

 “What Nate Silver’s success says about the 4th and 5th estates”

“Election 2012: Has Nate Silver destroyed punditry?” 

Nate Silver After the Election: The Verdict

As Forbes reporter wrote in his own post about Silver’s predictions, “the modelers are here to stay.”

Moving forward, I expect we’ll inevitably see an increased capability for organizations everywhere to adopt Silver’s methodical, Bayesian analytical strategies…and well beyond the political realm.

Live @ Information On Demand 2012: A Q&A With Nate Silver On The Promise Of Prediction

with 2 comments

Day 3 at Information On Demand 2012.

The suggestion to “Think Big” continued, so Scott Laningham and I sat down very early this morning with Nate Silver, blogger and author of the now New York Times bestseller, “The Signal and the Noise” (You can read the review of the book in the Times here).

Nate, who is a youngish 34, has become our leading statistician through his innovative analyses of political polling, but made his original name by building a widely acclaimed baseball statistical analysis system called “PECOTA.”

Today, Nate runs the award-winning political website FiveThirtyEight.com, which is now published in The New York Times and which has made Nate the public face of statistical analysis and political forecasting.

In his book, the full title of which is “The Signal and The Noise: Why Most Predictions Fail — But Some Don’t,” Silver explores how data-based predictions underpin a growing sector of critical fields, from political polling to weather forecasting to the stock market to chess to the war on terror.

In the book, Nate poses some key questions, including what kind of predictions can we trust, and are the “predicters” using reliable methods? Also, what sorts of things can, and cannot, be predicted?

In our conversation in the greenroom just prior to his keynote at Information On Demand 2012 earlier today, Scott and I probed along a number of these vectors, asking Nate about the importance of prediction in Big Data, statistical influence on sports and player predictions (a la “Moneyball”), how large organizations can improve their predictive capabilities, and much more.

It was a refreshing and eye-opening interview, and I hope you enjoy watching it as much as Scott and I enjoyed conducting it!

%d bloggers like this: