{"id":3978,"date":"2015-08-19T03:09:29","date_gmt":"2015-08-19T03:09:29","guid":{"rendered":"http:\/\/www.odbms.org\/blog\/?p=3978"},"modified":"2015-08-20T02:39:05","modified_gmt":"2015-08-20T02:39:05","slug":"on-hadoop-and-big-data-interview-with-lawrence-schwartz","status":"publish","type":"post","link":"https:\/\/www.odbms.org\/blog\/2015\/08\/on-hadoop-and-big-data-interview-with-lawrence-schwartz\/","title":{"rendered":"On Hadoop and Big Data. Interview with Lawrence Schwartz"},"content":{"rendered":"

“The best way to define Big Data ROI is to look at how our customers define it and benefit from Hadoop.
\nWellcare has been able to improve its query speeds from 30 days to just 7 days. This acceleration enabled the Company to increase its analytics and operational reporting by 73%.”–Lawrence Schwartz<\/strong><\/p><\/blockquote>\n

I have interviewed Lawrence Schwartz<\/a>, Chief Marketing Officer,Attunity<\/a>.<\/em><\/p>\n

RVZ<\/p>\n

Q1. What are the common challenges that enterprises face when trying to use\u00a0Hadoop?<\/strong><\/p>\n

Lawrence Schwartz: <\/strong>The advent of Hadoop and Big Data has significantly changed the way organizations handle data. There’s a need now for new skills, new organizational processes, new strategies and technologies to adapt to the new playing field. It\u2019s a change that permeates everywhere from how you touch the data, to how much you can support resource-wise and architecturally, to how you manage it and use it to stay competitive. Hadoop itself presents two primary challenges. First, the data has to come from somewhere. Enterprises must efficiently load high volumes of widely-varied data in a timely fashion. We can help with software that enables automated bulk loading into Hadoop without manual coding, and change data capture for efficient updates. The second challenge is finding engineers and Data Scientists<\/a> with the right skills to exploit Hadoop. Talent is scarce in this area.<\/p>\n

Q2. Could you give us some examples of how your customers use Hadoop for their businesses?<\/strong><\/p>\n

Lawrence Schwartz:<\/strong> We have an interesting range of customers using Hadoop, so I\u2019ll provide three examples. One major cable provider we are working with uses Hadoop as a data lake. They are integrating feeds from 200 data stores into Pivotal HD<\/a>. This data lake includes fresh enterprise data \u2013 fed in real-time, not just as an archival area \u2013 to run up-to-date reporting and analytics without hitting key transactional systems. This enables them to improve decision support and gain competitive advantage.<\/p>\n

Another example of how our customers are using Hadoop highlights a Fortune 50 high technology manufacturer. This customer\u2019s business analytics requirements were growing exponentially, straining IT resources, systems and budgets.\u00a0
\nThe company selected Attunity Visibility<\/a> to help it better understand its enterprise-wide data usage analytics across its various data platforms.
\nHaving this capability enables the company to optimize business performance and maximize its investment in its Hadoop, data warehouse and business analytics systems.\u00a0Attunity Visibility has helped to improve the customer\u2019s system throughput by 25% enabling them to onboard new analytic applications without increasing investment in data warehouse infrastructure.<\/p>\n

The third example is a financial services institution. This customer has many different data sources, including Hadoop, and one of its key initiatives is to streamline and optimize fraud detection. Using a historical analysis component, the organization would monitor real-time activity against historical trends to detect any suspicious activity. For example, if you go to a grocery store outside of your normal home ZIP code one day and pay for your goods with a credit card, this could trigger an alert at your bank. The bank would then see that you historically did not use your credit card at that retailer, prompting them to put a hold on your card, but potentially preventing a thief from using your card unlawfully. Using Attunity to leverage both historical and real-time transactions in its analytics, this company is able to decrease fraud and improve customer satisfaction.<\/p>\n

Q3. How difficult is it to perform\u00a0deep insight into data usage patterns?\u00a0<\/strong><\/p>\n

Lawrence Schwartz:<\/strong> Historically, enterprises just haven\u2019t had the tools to efficiently understand how datasets and data warehouse infrastructure are being used. We provide Visibility software that uniquely enables organizations to understand how tables and other Data Warehouse components are being used by business lines, departments, organizations etc. It continuously collects, stores, and analyzes all queries and applications against data warehouses. They are then correlated with data usage and\u00a0workload performance metrics in a centralized repository that provides detailed usage and performance metrics for the entire data warehouse. With this insight, organizations can place the right data on the right platform at the right time. This can reduce the cost and complexity of managing multiple platforms.<\/p>\n

Q4. Do you believe that\u00a0moving data across platforms is a feasible alternative for Big Data?\u00a0<\/strong><\/p>\n

Lawrence Schwartz:<\/strong> It really has to be, because nearly every enterprise has more than one platform, even before Hadoop is considered in the mix. Having multiple types of platforms also yields the benefits and challenges of trying to tier data based on its value, between data warehouses, Hadoop, and cloud offerings. Our customers rely on Attunity to help them with this challenge every day. Moving heterogeneous data in many different formats, and from many different sources is challenging when you don\u2019t have the right tools or resources at your disposal. The problem gets magnified when you\u2019re under the gun to meet real-time SLAs<\/a>. In order to be able to do all of that well, you need to have a way to understand what data to move, and how to move the data easily, seamlessly and in a timely manner. Our solutions make the whole process of data management and movement automated and seamless, and that’s our hallmark.<\/p>\n

Q5. What is “Application Release Automation” and why is it important for enterprises?<\/strong><\/p>\n

Lawrence Schwartz: <\/strong>Application release automation<\/a> (ARA) solutions are a proven way to support Agile development, accelerate release cycles, and standardize deployment processes across all tiers of the application and content lifecycles. ARA solutions can be used to support a wide variety of activities, ranging from publishing and modifying web site content to deploying web-based tools, distributing software to business end users, and moving code between Development, Test, and Production environments.<\/p>\n

Attunity addresses this market with an automation platform for enterprise server, web operations, shared hosting, and data center operations teams. Attunity ARA solutions are designed to offload critical, time-consuming deployment processes in complex enterprise IT environments. Enterprises that adopt ARA solutions enjoy greater business flexibility, improved productivity, better cross-team collaboration, and improved consistency.<\/p>\n

Q6. What is your relationships with\u00a0other Hadoop vendors?\u00a0<\/strong><\/p>\n

Lawrence Schwartz :<\/strong> <\/strong>Attunity has great working partnerships with all of the major Hadoop platform vendors, including Cloudera<\/a>, Hortonworks<\/a>, Pivotal<\/a> and MapR<\/a>. We have terrific synergy and work together towards a common goal \u2013 to help our customers meet the demands of a growing data infrastructure, optimize their Big Data environments, and make onboarding to Hadoop as easy as possible. Our solutions are certified with each of these vendors, so customers feel confident knowing that they can rely on us to deliver a complete and seamless joint solution for Hadoop.<\/p>\n

Q7. Attunity<\/strong>\u00a0recently acquired\u00a0<\/strong>\u00a0Appfluent Technology, Inc.\u00a0<\/strong>\u00a0and\u00a0<\/strong>BIReady<\/strong>. Why\u00a0Appfluent Technology? Why\u00a0BIReady?\u00a0How do these acquisitions fit into Attunity`s\u00a0overall strategy?<\/strong><\/p>\n

Lawrence Schwartz: <\/strong> <\/strong>When we talk with enterprises today, we hear about how they are struggling to manage mountains of growing data and looking for ways to make complex processes easier. We develop software and acquire companies that help our customers streamline and optimize existing systems as well as scale to meet the growing demands of business.<\/p>\n

Appfluent<\/a> brings the Visibility software I described earlier. With Visibility, companies can rebalance\u00a0data to improve performance and cost in high-scale, rapidly growing environments. They also can meet charge-back, show-back and audit requirements.<\/p>\n

BIReady, now known as Attunity Compose<\/a>, helps enterprises build and update data warehouses more easily. Data warehouse creation and administration is among the most labor-intensive and time-consuming aspects of analytics preparation. Attunity Compose overcomes the complexity with automation, using significantly less resources. It automatically designs, generates and populates enterprise data warehouses and data marts, adding data modeling and structuring capabilities inside the data warehouse.<\/p>\n

Q8. How do you define\u00a0Big Data ROI?<\/strong><\/p>\n

Lawrence Schwartz:<\/strong> The best way to define this is to look at how our customers define it and benefit from Hadoop.<\/p>\n

One of our Fortune 500 customers is Wellcare<\/a>, which provides managed care services to government-sponsored healthcare programs like Medicaid and Medicare. Wellcare plans to use our software to load data from its Pivotal data warehouse into Hadoop, where they will do much of their data processing and transformations. They will then move a subset of that data from Hadoop back into Pivotal and run their analytics from there. So in this case Hadoop is a staging area. As a result of implementing the first half of this solution (moving data from various databases into Pivotal), Wellcare has been able to improve its query speeds from 30 days to just 7 days. This acceleration enabled the Company to increase its analytics and operational reporting by 73%. At the same time, the solution helps Wellcare meet regulatory requirements in a timely manner more easily, ensuring that it receives the state and federal funding required to run efficiently and productively.<\/p>\n

In another example, one of our customers, a leading online travel services company, was dealing with exploding data volumes, escalating costs and an insatiable appetite for business analytics.\u00a0They selected Attunity Visibility to reduce costs and improve information agility by offloading data and workload from their legacy data warehouse systems to a Hadoop Big Data platform.\u00a0Attunity Visibility has saved the company over $6 million in two years by ensuring that the right workload and data are stored and processed on the most cost-effective platform based on usage.<\/p>\n

Resources<\/strong><\/p>\n

– CUSTOMER SPOTLIGHT WEBINAR SERIES: Healthcare Success Story \u2013 How WellCare Accelerated Big Data Delivery to Improve Analytics<\/a><\/p>\n

Related Posts<\/strong><\/p>\n

–Streamlining the Big Data Landscape: Real World Network Security Usecase By Sonali Parthasarathy Accenture Technology Labs. ODBMS.org<\/a><\/p>\n

–Thirst for Advanced Analytics Driving Increased Need for Collective Intelligence By John K. Thompson \u2013 General Manager, Advanced Analytics, Dell Software -August 2015, ODBMS.org<\/a><\/p>\n

– Evolving Analytics by Carlos Andre Reis Pinheiro, Data Scientist, Teradata. ODBMS.org<\/a><\/p>\n

– Business Requirements First, Technology Second BY Tamara Dull, Director of Emerging Technologies, SAS Best Practices, ODBMS.org<\/a><\/p>\n

– A Cheat Sheet: What Executives Want to Know about Big Data by Tamara Dull, Director of Emerging Technologies for SAS Best Practices, ODBMS.org<\/a><\/p>\n

Follow ODBMS.org on Twitter: @odbmsorg<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

“The best way to define Big Data ROI is to look at how our customers define it and benefit from Hadoop. Wellcare has been able to improve its query speeds from 30 days to just 7 days. This acceleration enabled the Company to increase its analytics and operational reporting by 73%.”–Lawrence Schwartz I have interviewed […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[35,845,66,105,239,258,844,354,649],"_links":{"self":[{"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/posts\/3978"}],"collection":[{"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/comments?post=3978"}],"version-history":[{"count":6,"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/posts\/3978\/revisions"}],"predecessor-version":[{"id":3995,"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/posts\/3978\/revisions\/3995"}],"wp:attachment":[{"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/media?parent=3978"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/categories?post=3978"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.odbms.org\/blog\/wp-json\/wp\/v2\/tags?post=3978"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}