Getting Started with Big SQL tech preview

Big SQL 3.0 brings a native SQL MPP engine to Hadoop.  This engine brings rich SQL support, federation, security, RBAC,  UDFs, stored procedures and much more.   How SQL rich is it?   Look at the Video replay below to learn about the TPC-H and TPC-DS SQL workloads and the amount of queries that were used.  Not only do you get richer SQL but it is faster.   Big SQL is a feature of IBM's Hadoop distribution (BigInsights).

Where can you learn more?   There are lots of resources to learn more about Big SQL 3.0.  Here is a short list of resources:

• White Paper

• Presentations 
• Taming Big Data with Big SQL 3, 
• Big SQL 3.0: Datawarehouse-grade Performance on Hadoop - At last!

• Video replay 
• Upcoming SQL on Hadoop meetups ( Chicago, Bangalore, Moscow, Mexico City, Melbourne, Boston, Philadelphia, London...)
• Past (Toronto, Silicon Valley, Madrid, Dallas, Pittsburgh, RTP, Phoenix, Zurich, Vancouver,  NYC)

And finally try it yourself on the cloud via the Big SQL Tech Preview.   BTW, a getting started tutorial is included with the Big SQL tech preview under the resources tab and there are also additional links to many of the resources above.  

The BigInsights 3.0 QSE VM is also now available to try Big SQL.  You can also find an additional Big SQL hands on lab geared towards the VM on Hadoop Dev.

Explore the power of Big Data analytics with Hadoop at dev@Impact

Will you be at at Impact 2014?   Curious about Hadoop?  Join us for the following hands on session at dev@Imapct.

This event is part of the Impact 2014 conference so if you would like to join us you will need to be a registered conference attendee. You can sign up here.

Session DSA-3462 : Title: Explore the power of Big Data analytics with Hadoop 

Curious about Big Data? Want to learn how to use Hadoop for storing and analyzing Big Data, developing Big Data applications, and integrating Big Data into your existing IT infrastructure?  Join us to work through hands-on lab exercises and to explore technologies that businesses use to support Big Data analytics. This lab is geared towards technical staff with little or no background in Big Data. Remember to bring your laptops for the lab.

When: April 29th (Tues)1-6 pm

Where: Impact Conference in Las Vegas - Venetian, Sands 304

How to setup your machine to run the lab:
     Get VM: http://ibm.co/streamsqs
     Setup Video: https://ibm.biz/BdRJ23

You can learn about other (Mobile, Cloud, IoT) dev@Impact sessions at:
     https://www.ibmdw.net/bluemix/docs/workshops/impact2014/

Learn more about Big Data for free at Big Data University

Free new pureQuery eBook

The free Getting Started with pureQuery e-book is available for download.  This book was put together by many of the key pureQuery developers, technical evangelists and reviewed by some key customers.

This is the best collection of pureQuery info in book form and definitely the best way to get started.

Read this free ebook to:

• Find out what pureQuery is
• Learn how to get started and review configuration options. 
• Learn how to use pureQuery tooling in Optim™ Development Studio (ODS)
• This reviews the major pureQuery tooling features found in ODS
• BTW did I mention that the ODS tooling is free.
• pureQuery ODS tooling provides help to any Java developer writing data access with JDBC, pureQuery, iBatis, and JPA for DB2 and IDS.
• Write efficient Java™ database applications using pureQuery APIs
• Discover what is different about pureQuery and review APIs
• Learn how to optimize your existing Java database applications using pureQuery
• pureQuery is a data access platform, so it makes it easier to developer data access application for DB2 & IDS and also faster.
• Understand how pureQuery can optimize Java Persistence API (JPA) and Hibernate applications
• Make you existing ORM apps faster and easier to write.
• Practice while developing a sample Java application
• Are you looking for a sample application that uses pureQuery to help you get started?  If so look no further because you can find it in the ebook.

It's Alive!!!! IBM BigInsight (Hadoop ++)

Well the time has come for IBM's BigInsight product to be released to the general public.  It comes in 2 flavors:

• IBM InfoSphere BigInsights Enterprise Edition 
• I'm just going to call in BigInsight EE
• Here is the program number for those so inclined: 5725-C09
• IBM InfoSphere BigInsights Basic Edition (aka free)
• Let me call this one just BigInsight Basic
• Here is the part number for those so inclined: DOJIHLL 

Here is a quick summary of what's in BigInsights EE:

• Open Source Components
• Pig (programming language)
• Flume (data collection/aggregation)
• Hive (data summarization/querying)
• Lucene (text search)
• Zookeeper (process coordination)
• Avro (data serialization)
• HBase (real time read/write)
• Some IBM Extras
• JAQL
• InfoSphere Warehouse Integration
• text analytics engine

Look for more details coming soon!

Whaz up? IBM Big Data

Are you curious about whaz happening with IBM Big Data?    Have you heard about some of these IBM Products/Projects/Initiatives: InfoSphere BigInsight, BigSheets, InfoSphere Streams, InfoSphere SenseMaking (aka G2), Cognos Consumer Insight, IBM Distribution of Apache Hadoop, System-T, System ML, etc ...

To keep up with news and whaz happening here are some social media channels:

• IBM BigData Twitter @IBMBigData
• IBM BigData Facebook
• IBM BigData blog
• IBM BigData developerWorks blog
• Planet Big Data - Blog Aggregator
• Planet Big Data - Twitter Feed

Here are some InfoSphere Streams communities:

• IBM developerWorks Streams Processing Group
• IBM developerWorks Streams Exchange Group
• Streams samples and examples

Let me know if I should add anything! 

=)
Rafael

TechCrunchTV Interview Anjul Bhambhri (VP of Big Data at IBM) on IBM's Big Data direction

TechCrunchTV did a 5 piece interview with Anjul on March 30, 2011 on IBM's Big Data direction

Part1

• Anjul talking about her early career and how did she get to managing IBM's Big Data mission.

Part2

• Talks about Watson's role in Big Data. Anjul suggest that humanity should celebrate its accomplishment.  Watson has something like 200 million pages of data (ie dictionaries, thesaurus, etc ..).     The challenge was to ingest, search and makes sense of Big Data to be able to respond to a question.  
  

Part3

• Waton is becoming more like "human".  Watson is a good example of how a computer can understand natural language and how a computer can understand Big Data.  Computers or robots can not replace humans.  
  

Part4

• What's IBM's goal in the investment in Watson?  The possibilities if we can tap into Big Data and do analytics can drive change in our society (eg Smarter Planet, Health care, etc ...).   The possibility to be able to make a decision at the right time.   IBM's is working on simplifying analytics on Big Data (aka making it easier to ask questions on Big Data).
  

Part5

• IBM is more than just about mainframes.  Anjul's business is managed as a start-up within IBM.  IBM is looking at helping customers consume and make sense of Big Data(petabytes++) along with their traditional data.   IBM's is working on helping customer's make sense of their growing amount of data.  IBM is starting 1200 bootcamps on the technology behind Watson and what IBM's doing around Big Data.   This bootcamps will be able to help with concepts, labs/example, Proof of Concept, etc... around Big Data.

IOD 2010 IBM Optim Session

Steve Rees and I are doing a session on Thursday on leveraging the DB2 LUW Performance Best Practice with Optim Performance Manager (aka OPM)

Offering    Day/Time    Session #    Title
IDA    Mon 10:15-11:15am    TDM-2341A    Modeling and Designing Databases with IBM InfoSphere Data Architect: A User Experience
OPM    Mon 10:15-11:15am    TLU-1871A    IBM Optim Performance Manager V4.1 for IBM DB2 on Linux, UNIX, and Windows
Portfolio    Mon, 2:15 - 5:15pm & Drop-In Lab    HOL-1688A DIL-7004    Managing System Performance with Optim on LUW
Portfolio    Mon, 2:15-3:15pm    TDM-2597A    IBM Optim and IBM Data Studio Portfolio Strategy: Optimize Performance and Availability while Reducing Costs
DB2 Connect    Mon, 2:15-3:15pm    TDZ-3056A    IBM DB2 Connect Technology Update
QWT    Mon, 2:15-3:15pm    TDZ-1754A    Optim Query Tuning Solution: Tuning a Critical SAP Application
QT/QWT    Mon, 3:45-5pm    TDZ-1790A    Query Optimization and SQL Performance Tuning Using IBM Optim Query Tuning Offerings for DB2 for z/OS
OPM    Mon, 3:45pm - 5pm    TLU-2418A    Best Practices for Workload Management Using IBM Optim Performance Managert Best Practices Using Optim Performance Manager

Portfolio    Tue 11:15am-12:15pm    TLU-2761A    Real-Life Best Practices with IBM Optim Integrated Data Management from the GBS DBA Practitioners Perspective
Backup/Recovery    Tue, 1:45pm - 2:45pm    TLU-2144A    Delta Database Experiences Using the New Backup and Recovery Tooling for DB2 Linux, UNIX and Windows
pureQuery    Tue, 11:15am - 12:15pm    TDZ-1309A    Optim pureQuery Runtime for z/OS
Portfolio    Tue, 3-4pm    TDM-2881A    Managing the Performance of Your IBM DB2 zOS Applications by Using IBM Optim Solutions

OPM    Wed, 11:30am - 12:30pm    TLU-2135A    Troubleshooting IBM WebSphere Application Transactions on IBM DB2 with IBM Tivoli Composite Application Manager and IBM Optim Performance Manager
Portfolio    Wed, 2-5pm    HOL-1566A    Manage Performance of your DB2 z/OS Applications using Optim Solutions
pureQuery    Wed, 6-7pm    BOF-2413A    Extract the most value from .NET and ODBC Applications
pureQuery    Wed, 6-7pm    BOF-2965A    End to End data security with Guardium and pureQuery
OPM    Wed, 6-7pm    BOF-1875A    Optimizing Your Business System Using IBM Optim Performance Manager

pureQuery    Thu 11:30am - 12:30pm    TDM-2573A    What's New for IBM Optim pureQuery in Enterprise Java Data Access
IDA    Thu 1-1:45pm    BOF-2803B    InfoSphere Data Architect and Data Modelers User Group
pureQuery    Thu 1-1:45pm    BOF-2777C    Optim pureQuery User Group and  Fans
Portfolio    Thu 2-3pm    TDM-2018A    Client success with an IBM Optim Performance Solution
Portfolio    Thu 8:15 - 11:15am & Drop-In Lab    HOL-1650A   DIL-7003    Best Practices Developing DB2 Applications with Optim Solutions
Portfolio    Thu 8:15-9:30am    TDM-2471A    Can You Benefit from IBM Optim Solutions? Yes! Come Hear Our Client Success Stories
Admin solutions    Thu, 11:30am - 12:30pm    TLU-1721B    Empowering DBAs with IBM Optim Administration and Tuning Tools
OPM    Thu, 3:30-4:30pm    TLU-2330B    Transforming Performance: Best Practices for Monitoring and Tuning IBM DB2 for Linux, UNIX and Windows
pureQuery    Drop-In Lab    DIL-1009    Auto tuning Hibernate Java Applications With DB2