Welcome!

SDN Journal Authors: Pat Romanski, Elizabeth White, Gil Allouche, Lori MacVittie, Dana Gardner

Related Topics: Big Data Journal, Java, Linux, Virtualization, Cloud Expo, SDN Journal

Big Data Journal: Article

Supercomputing Tackle Big Data Challenges

Bringing innovations to the Big Data era

We all feel it, data use and growth is explosive. Individuals and businesses are consuming - and generating - more data every day.

The challenges are common for nearly all businesses operating in every industry:  ingest all the data, analyze it as fast as possible, make good sense of it, and ultimately drive smart decisions to positively affect the business - all as fast as possible!

Fujitsu brings the processors of supercomputing in the Fujitsu M10 enterprise server family to help organizations meet these everyday challenges.  What once was reserved for data-intensive scientific computing is now especially relevant to mission-critical business computing, and it's all driven by big data.

Fujitsu M10 Server Family

Fujitsu M10 Server Family:  Fujitsu M10-1, Fujitsu M10-4, Fujitsu M10-4S

From high-throughput connectivity to data sources, to high-speed data movement to and from high-performance processing units, all the way to serving data and analytics results for mission-critical business intelligence (BI) applications, Fujitsu's innovative technologies leveraged from decades in High-Performance Computing (HPC) enable enterprises to impact decisions, boost business productivity, and enhance the bottom line.

Dynamic Scaling

The Fujitsu M10 server line ranges from one to 64 SPARC64 X+ processors, each with 16 cores at speeds up to 3.7 GHz.   Extending the existing SPARC V9 instruction set architecture, the SPARC64 X+ adopts HPC-ACE (High Performance Computing Arithmetic Computational Extension), which was developed for the Fujitsu supercomputers. "Software on Chip" technology on all M10 models enables faster computational results by taking functions previously handled by software and putting them right into the processor itself. Through this innovative approach, the decimal floating-point arithmetic processing required by financial applications and database computing is done directly on the hardware in the processor, eliminating the overhead of binary-to-decimal conversions and speeding up overall computational results. Further, Single Instruction Multiple Data (SIMD) technology, once reserved only for HPC, also allows processing of multiple data in a single instruction cycle, dramatically accelerating results. This vector processing capability allows certain workloads such as columnar databases and business analytics to process massive data faster.

SPARC64 X+ processor die: 16 cores

SPARC64 X+ processor die: 16 cores

The Fujitsu M10's interconnect technology matches the power of its processors.  Fujitsu's innovative high-performance interconnect provides high bandwidth and low latency for high-speed internal data access and transfers among all SPARC64 X+ processors in the Fujitsu M10 server. All processors access all memory and all I/O slots equally, so that a large workload is as easy to deploy and support as a smaller workload.

Fujitsu M10 also offers the latest PCI Express serial I/O technology to provide fast connectivity to data warehouses, operational systems and other data sources.  The data can be fed to high performance BI systems through as many as 128 internal I/O slots on the Fujitsu M10 servers and up to 928 slots with the optional PCI Expansion Units.

SPARC64 X+ Processor

With the extreme performance of SPARC64 X+ processors and unrivaled utilization efficiency through innovative high performance supercomputing technologies, the Fujitsu M10 servers allow customers to quickly leverage large data sets and access the critical information they need for real-time decisions in ever-changing environments.  It helps companies get results with Big Data, faster.

More Stories By Ferhat Hatay

Dr. Ferhat Hatay is product marketing lead with Fujitsu Oracle Center of Excellence (FOrCE) supporting Fujitsu M10 servers worldwide. His experience includes serving in key roles at Sun Microsystems, Oracle, and HAL (A Fujitsu Company, not the HAL 9000!) driving innovative open large-scale infrastructure solutions for high performance and enterprise computing. Ferhat started his career at NASA Ames Research Center building infrastructures for large-scale computer simulations and Big Data analysis. He forever remains a rocket scientist. Follow him at Twitter: @FerhatSF.

@CloudExpo Stories
Connected devices and the Internet of Things are getting significant momentum in 2014. In his session at Internet of @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, examined three key elements that together will drive mass adoption of the IoT before the end of 2015. The first element is the recent advent of robust open source protocols (like AllJoyn and WebRTC) that facilitate M2M communication. The second is broad availability of flexible, cost-effective ...
How do APIs and IoT relate? The answer is not as simple as merely adding an API on top of a dumb device, but rather about understanding the architectural patterns for implementing an IoT fabric. There are typically two or three trends: Exposing the device to a management framework Exposing that management framework to a business centric logic Exposing that business layer and data to end users. This last trend is the IoT stack, which involves a new shift in the separation of what stuff happe...
The Internet of Things will put IT to its ultimate test by creating infinite new opportunities to digitize products and services, generate and analyze new data to improve customer satisfaction, and discover new ways to gain a competitive advantage across nearly every industry. In order to help corporate business units to capitalize on the rapidly evolving IoT opportunities, IT must stand up to a new set of challenges. In his session at @ThingsExpo, Jeff Kaplan, Managing Director of THINKstrateg...
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water,...
"Matrix is an ambitious open standard and implementation that's set up to break down the fragmentation problems that exist in IP messaging and VoIP communication," explained John Woolf, Technical Evangelist at Matrix, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
DevOps is all about agility. However, you don't want to be on a high-speed bus to nowhere. The right DevOps approach controls velocity with a tight feedback loop that not only consists of operational data but also incorporates business context. With a business context in the decision making, the right business priorities are incorporated, which results in a higher value creation. In his session at DevOps Summit, Todd Rader, Solutions Architect at AppDynamics, discussed key monitoring techniques...
Want to enable self-service provisioning of application environments in minutes that mirror production? Can you automatically provide rich data with code-level detail back to the developers when issues occur in production? In his session at DevOps Summit, David Tesar, Microsoft Technical Evangelist on Microsoft Azure and DevOps, will discuss how to accomplish this and more utilizing technologies such as Microsoft Azure, Visual Studio online, and Application Insights in this demo-heavy session.
When an enterprise builds a hybrid IaaS cloud connecting its data center to one or more public clouds, security is often a major topic along with the other challenges involved. Security is closely intertwined with the networking choices made for the hybrid cloud. Traditional networking approaches for building a hybrid cloud try to kludge together the enterprise infrastructure with the public cloud. Consequently this approach requires risky, deep "surgery" including changes to firewalls, subnets...
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
One of the biggest challenges when developing connected devices is identifying user value and delivering it through successful user experiences. In his session at Internet of @ThingsExpo, Mike Kuniavsky, Principal Scientist, Innovation Services at PARC, described an IoT-specific approach to user experience design that combines approaches from interaction design, industrial design and service design to create experiences that go beyond simple connected gadgets to create lasting, multi-device exp...
P2P RTC will impact the landscape of communications, shifting from traditional telephony style communications models to OTT (Over-The-Top) cloud assisted & PaaS (Platform as a Service) communication services. The P2P shift will impact many areas of our lives, from mobile communication, human interactive web services, RTC and telephony infrastructure, user federation, security and privacy implications, business costs, and scalability. In his session at @ThingsExpo, Robin Raymond, Chief Architect...
High-performing enterprise Software Quality Assurance (SQA) teams validate systems that are ready for use - getting most actively involved as components integrate and form complete systems. These teams catch and report on defects, making sure the customer gets the best software possible. SQA teams have leveraged automation and virtualization to execute more thorough testing in less time - bringing Dev and Ops together, ensuring production readiness. Does the emergence of DevOps mean the end of E...
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using ...
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series dat...
"Verizon offers public cloud, virtual private cloud as well as private cloud on-premises - many different alternatives. Verizon's deep knowledge in applications and the fact that we are responsible for applications that make call outs to other systems. Those systems and those resources may not be in Verizon Cloud, we understand at the end of the day it's going to be federated," explained Anne Plese, Senior Consultant, Cloud Product Marketing at Verizon Enterprise, in this SYS-CON.tv interview at...
"For the past 4 years we have been working mainly to export. For the last 3 or 4 years the main market was Russia. In the past year we have been working to expand our footprint in Europe and the United States," explained Andris Gailitis, CEO of DEAC, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The Domain Name Service (DNS) is one of the most important components in networking infrastructure, enabling users and services to access applications by translating URLs (names) into IP addresses (numbers). Because every icon and URL and all embedded content on a website requires a DNS lookup loading complex sites necessitates hundreds of DNS queries. In addition, as more internet-enabled ‘Things' get connected, people will rely on DNS to name and find their fridges, toasters and toilets. Acco...
The term culture has had a polarizing effect among DevOps supporters. Some propose that culture change is critical for success with DevOps, but are remiss to define culture. Some talk about a DevOps culture but then reference activities that could lead to culture change and there are those that talk about culture change as a set of behaviors that need to be adopted by those in IT. There is no question that businesses successful in adopting a DevOps mindset have seen departmental culture change, ...
"Cloud consumption is something we envision at Solgenia. That is trying to let the cloud spread to the user as a consumption, as utility computing. We want to allow the people to just pay for what they use, not a subscription model," explained Ermanno Bonifazi, CEO & Founder of Solgenia, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Enthusiasm for the Internet of Things has reached an all-time high. In 2013 alone, venture capitalists spent more than $1 billion dollars investing in the IoT space. With "smart" appliances and devices, IoT covers wearable smart devices, cloud services to hardware companies. Nest, a Google company, detects temperatures inside homes and automatically adjusts it by tracking its user's habit. These technologies are quickly developing and with it come challenges such as bridging infrastructure gaps,...