SDN Journal Authors: Yeshim Deniz, Pat Romanski, Elizabeth White, Liz McMillan, TJ Randall

Related Topics: @DXWorldExpo, Agile Computing, @CloudExpo, Apache, Cloud Security, SDN Journal

@DXWorldExpo: Article

Handling eDiscovery in the Context of Big Data

Accessing expertise to manage complex eDiscovery requests

Big Data - a large amount of information that comes in a variety of forms and constantly changes - has generated a significant amount of buzz in the business world, mostly around the implications for marketing. But there's little attention paid to its potential impact on risk management and legal issues. There should be. When legal compliance actions such as eDiscovery requests involve large datasets, most businesses don't have the in-house expertise to handle the task.

This is true both of companies that manage legal compliance internally and those that turn to external experts who don't specialize in eDiscovery. Discovery requests that involve truly massive datasets require special expertise and technology tools, and most in-house resources and even outside technology experts who are not specifically trained to handle eDiscovery in a Big Data context are unaware of the scale of the challenge.

Big Data and eDiscovery: Special Considerations
Most companies that tap Big Data for marketing initiatives quickly realize that they need specialized expertise to handle the unique requirements of working with huge datasets, and yet many have not had that realization when it comes to eDiscovery and Big Data. The fact is, handling eDiscovery in the context of Big Data is even more challenging because there are legal standards that must be upheld.

Information that companies mine for eDiscovery purposes must conform to rigorous data integrity and evidence handling procedures that are far stricter than those used in routine data migration and IT processing events. The expertise and tools required exceed those generally used to parse Big Data for business intelligence.

Special handling requirements include detailed accounts of how data was created, transferred, accessed and stored, which are not generally available from Big Data analysis tools created for business purposes. For compliant eDiscovery, companies must provide evidence of data integrity and demonstrate handling procedures that conform to legal standards so that the evidence produced is admissible in court and for use in legal actions, regulatory examinations, administrative hearings or private arbitration.

Since the data in question generally comprises documents created in a range of formats and stored across multiple locations (e.g., email folders, mobile devices, central business servers, etc.), eDiscovery in the Big Data context is that much more complicated to identify, collect and analyze. But companies that fail to do so in an appropriate fashion can face substantial fines.

Accessing Expertise to Manage Complex eDiscovery Requests
The Big Data tools currently available for mining and analytics aren't up to the task of handling eDiscovery in a compliant way. But luckily, companies that need these services can find affordable solutions. There are services available that have the specialized legal and technical expertise to identify, analyze and produce documents according to exacting legal standards - and complete the job quickly so legal professionals can meet their deadlines.

A competent eDiscovery partner can analyze Big Data to identify relevant email communications, important records, presentations and other key documents using specialized technology to separate relevant material from massive quantities of extraneous data. They can use advanced search methods that conform to computer forensics best practices and evidentiary rules to produce the evidence needed in a compliant manner.

Company leaders, IT professionals and other employees who are involved in eDiscovery requests should be fully aware of the scale of the task they face when asked to produce documents from large datasets. It's wise to have an eDiscovery policy in place to ensure that requests involving legal and regulatory matters are handled appropriately.

Managing eDiscovery requests in the context of Big Data poses many challenges, but it's important for executives, IT managers and other personnel charged with the task to get it right. Not doing so can expose the company to significant risks. For these reasons, businesses facing an eDiscovery action that involves Big Data should make sure they access the resources they need to handle it appropriately.

More Stories By Alon Israely

Alon Israely, co-founder and leader of the Strategic Partner Program at Business Intelligence Associates (BIA), works with clients to integrate BIA’s cloud software product, Total Discovery. A lawyer with more than 15 years of experience developing advanced computing technologies, he has consulted with corporations and their law firms on a variety of technology issues, including expert witness services related to computer forensics, digital evidence management and information security. Previously, he was a senior member of several IT teams working on projects for Fortune 500 companies related to global network architecture and data migration projects for enterprise information systems. Find out more at www.totaldiscovery.com.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@CloudExpo Stories
Andi Mann, Chief Technology Advocate at Splunk, is an accomplished digital business executive with extensive global expertise as a strategist, technologist, innovator, marketer, and communicator. For over 30 years across five continents, he has built success with Fortune 500 corporations, vendors, governments, and as a leading research analyst and consultant.
"Cloud computing is certainly changing how people consume storage, how they use it, and what they use it for. It's also making people rethink how they architect their environment," stated Brad Winett, Senior Technologist for DDN Storage, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
In his session at 20th Cloud Expo, Brad Winett, Senior Technologist for DDN Storage, will present several current, end-user environments that are using object storage at scale for cloud deployments including private cloud and cloud providers. Details on the top considerations of features and functions for selecting object storage will be included. Brad will also touch on recent developments in tiering technologies that deliver single solution and an end-user view of data across files and objects...
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settl...
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
It is ironic, but perhaps not unexpected, that many organizations who want the benefits of using an Agile approach to deliver software use a waterfall approach to adopting Agile practices: they form plans, they set milestones, and they measure progress by how many teams they have engaged. Old habits die hard, but like most waterfall software projects, most waterfall-style Agile adoption efforts fail to produce the results desired. The problem is that to get the results they want, they have to ch...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.
Without a clear strategy for cost control and an architecture designed with cloud services in mind, costs and operational performance can quickly get out of control. To avoid multiple architectural redesigns requires extensive thought and planning. Boundary (now part of BMC) launched a new public-facing multi-tenant high resolution monitoring service on Amazon AWS two years ago, facing challenges and learning best practices in the early days of the new service.
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
The best way to leverage your CloudEXPO | DXWorldEXPO presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering CloudEXPO | DXWorldEXPO will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at CloudEXPO. Product announcements during our show provide your company with the most reach through our targeted audienc...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors!
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
JETRO showcased Japan Digital Transformation Pavilion at SYS-CON's 21st International Cloud Expo® at the Santa Clara Convention Center in Santa Clara, CA. The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get...
Both SaaS vendors and SaaS buyers are going “all-in” to hyperscale IaaS platforms such as AWS, which is disrupting the SaaS value proposition. Why should the enterprise SaaS consumer pay for the SaaS service if their data is resident in adjacent AWS S3 buckets? If both SaaS sellers and buyers are using the same cloud tools, automation and pay-per-transaction model offered by IaaS platforms, then why not host the “shrink-wrapped” software in the customers’ cloud? Further, serverless computing, cl...
"We view the cloud not as a specific technology but as a way of doing business and that way of doing business is transforming the way software, infrastructure and services are being delivered to business," explained Matthew Rosen, CEO and Director at Fusion, in this SYS-CON.tv interview at 18th Cloud Expo (http://www.CloudComputingExpo.com), held June 7-9 at the Javits Center in New York City, NY.
DXWorldEXPO LLC announced today that the upcoming DXWorldEXPO | CloudEXPO New York event will feature 10 companies from Poland to participate at the "Poland Digital Transformation Pavilion" on November 12-13, 2018.
The current age of digital transformation means that IT organizations must adapt their toolset to cover all digital experiences, beyond just the end users’. Today’s businesses can no longer focus solely on the digital interactions they manage with employees or customers; they must now contend with non-traditional factors. Whether it's the power of brand to make or break a company, the need to monitor across all locations 24/7, or the ability to proactively resolve issues, companies must adapt to...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...