Sentiment Analysis

Introduction

Sentiment analysis is a natural language processing technique that determines whether a piece of textual data is positive, negative or neutral. For example, it can use to help small business owners to analyse customer feedback, monitor business performance and understand customer needs easier.

Actable AI provides word cloud and sentiment category results for provided texts.

Parameters

  • Text: The column of text from which keywords and their sentiments are extracted.
  • Minimum Frequency: Only keywords mentioned more than the set value would be displayed in word cloud. Changing this control takes effect instantly in the result panel.
  • Filters (optional): Set conditions on columns to filter on the original dataset. If selected, only a subset of the original data would be used in the analytics.

Customize panel is used for word cloud appearence customization. All the following parameter would take effect instantly after change.

  • Minimum Font Size: Font size for the smallest value in the list.
  • Maximum Font Size: Font size for the biggest value in the list.
  • Word Rotation: Rotation to apply to words in the cloud.
  • Linear Color Scheme: Color scheme for the word cloud.

Case Study

We would like to analyse latest economic news. Here is a table of the sample data.

TEXT
NEW YORK – Yields on most certificates of deposit offered by major banks dropped more than a tenth of a percentage point in the latest week, reflecting the overall decline in short-term interest rates.</br></br>On small-denomination, or “consumer,” CDs sold directly by banks, the average yield on six-month deposits fell to 5.49% from 5.62% in the week ended yesterday, according to an 18-bank survey by Banxquote Money Markets, a Wilmington, Del., information service.</br></br>On three-month “consumer” deposits, the average yield sank to 5.29% from 5.42% the week before, according to Banxquote. Two banks in the Banxquote survey, Citibank in New York and CoreStates in Pennsylvania, are paying less than 5% on threemonth small-denomination CDs.</br></br>Declines were somewhat smaller on five-year consumer CDs, which eased to 7.37% from 7.45%, Banxquote said.</br></br>Yields on three-month and six-month Treasury bills sold at Monday’s auction plummeted more than a fifth of a percentage point from the previous week, to 5.46% and 5.63%, respectively.
The Wall Street Journal Online</br></br>The Morning Brief, a look at the day’s biggest news, is emailed to subscribers by 7 a.m. every business day. Sign up for the e-mail here.</br></br>On Friday evening, with Congress out of town on its summer recess and Americans heading into a mid-August weekend, the Bush administration sent a message to the states: The federal government will make it tougher for a national children’s insurance program to cover the offspring of middle-income families.</br></br>The State Children’s Health Insurance Program was created in 1997 to help children whose families couldn’t afford insurance but didn’t qualify for Medicaid, and administration officials tell the New York Times that the changes are aimed at returning the program to its low- income focus and assuring it didn’t become a replacement for private insurance. Administration point man Dennis Smith wrote to state officials saying there would be new restrictions on the District of Columbia and the 18 states – including California and New York – that extend or plan to extend coverage for children whose families make more than 250% of Federal poverty levels. For a family of three that 250% is $42,900, and for a family of four it’s $51,625. Under the new limits, a child from a family making more would have to spend one year uninsured before qualifying, and any state that wants to extend coverage would have to assure Washington that at least 95% of children eligible for SCHIP or Medicaid are enrolled in one of the programs. But as the Associated Press reports, no state can currently make such assurances.</br></br>Rachel Klein, deputy director of health policy for advocacy group Families USA, tells the AP that since many families above the 250% threshold can’t afford private insurance, “the effect of this policy is to have more uninsured kids.” Ann Clemency Kohler, deputy commissioner of human services in New Jersey, tells the Times the changes “will cause havoc with our program and could jeopardize coverage for thousands of children.” States have already been imposing waiting periods and taking other steps to prevent parents from moving their children from private insurance to SCHIP, which currently serves some 6.6 million children, the Washington Post notes. The administration’s new restrictions come as the program, which expires at the end of next month if Congress doesn’t reauthorize it, is the subject of a larger political fight that pits the White House against Democrats and some Republicans in Congress and state capitals.
WASHINGTON – In an effort to achieve banking reform, Senate negotiators and the Bush administration have agreed to drop efforts to allow banks to expand further into the securities business.</br></br>The compromise is one of several the Senate Banking Committee is pursuing to remove obstacles its banking bill will face when the Senate starts voting on the measure, perhaps today. The latest version of the House banking bill also drops the administration’s proposals to broaden bank entry into the securities business.</br></br>Last night, the House began its second attempt to pass a banking bill after failing last week, in part because of disagreement over how to allow banks into the securities business. The House adopted on a voice vote provisions that would replenish the bank deposit insurance fund, tighten bank regulation, trim the scope of deposit insurance, and restrict the Federal Reserve Board’s ability to keep sick banks alive with loans.</br></br>But the House delayed until today a vote on an amendment to allow banks to branch nationwide and on final passage of the banking bill to give the House leadership and the administration more time to drum up support for the bill.</br></br>House Speaker Thomas Foley (D., Wash.) is working hard to win passage of the bill in the face of significant opposition from Rep. John Dingell (D., Mich.), who believes the bill should include provisions imposing stiffer regulation on banks in the securities business.
The statistics on the enormous costs of employee drug abuse are well known (at least $70 billion per year, according to December 1985 testimony before the House Labor Subcommittee on Health and Safety). Management is under pressure to reduce productivity losses, turnover, insurance costs and the risk of lawsuits for personal and property damage caused by drug-impaired workers. Management also is under sales pressure from a growing cadre of laboratories, test-kit manufacturers and consultants who extol the virtues of testing. A common argument is the following: “Your competitors are starting to require drug tests. If you don’t, their work force will be clean and you will end up with all the junkies.”</br></br>Many companies that have implemented widespread drug-testing programs, however, have learned that there is a downside to testing. They have experienced the protests of employees and civil libertarians and have watched the proliferation of lawsuits alleging invasion of privacy, defamation and other legal theories. A Texas railroad employee was awarded $200,000 in damages when his employer misreported the results of a drug test. Numerous other cases are pending.</br></br>Is there a middle ground? Can safety and efficiency be protected without invading the privacy of applicants and employees?</br></br>A growing number of companies have concluded that drug testing should be the least important part of a comprehensive drug-abuse program. The starting point is a drug-awareness program to educate managers, supervisors and employees about the dangers and signs of drug abuse. The second part of the program is an effective employee-assistance program (EAP). Rehabilitation is preferable to punishment or dismissal (at least for initial or nonserious offenses) because it encourages employees to seek help voluntarily, improves labor relations and is cost-effective by restoring valuable employees to productive status. More than one company that heedlessly adopted a “screen and fire” policy on drugs had second thoughts after discovering traces of drugs in some of their most productive employees.</br></br>There may be a place for drug testing in a company’s drug-abuse program, but there are limits to the effectiveness of testing. To begin with, the accuracy of some drug tests varies widely, and the test results are often unacceptable even when performed by professional laboratories. Last year the Centers for Disease Control published the results of a 10-year study of laboratory testing for amphetamines, barbiturates, cocaine, codeine, methadone and morphine. Virtually all of the laboratories in the study had unacceptably high error rates.
NEW YORK – Indecision marked the dollar’s tone, as traders paused for breath, awaiting a critical monthly U.S. employment report for release today.</br></br>The dollar ended the New York day slightly weaker against both the euro and the yen.</br></br>Market participants were also reluctant to make major bets on the yen, following a stream of more rigorous-sounding statements from top Japanese officials about the issue of bank reforms.</br></br>Late yesterday afternoon in New York, the euro was at 98.77 cents, slightly stronger than its 98.68-cent level late Wednesday. Against the yen, the dollar was trading at 122.59 yen, down modestly from 122.84 yen. Against the Swiss franc, the dollar was at 1.4782 francs, unchanged, while sterling was changing hands at $1.5698, up from $1.5689.</br></br>The euro managed to raise its head briefly above 99 cents during New York trade, for the first time in roughly four weeks, taking advantage of some softness in stock markets and some worries about the state of the U.S. economic recovery ahead of the employment report.

We set our parameters as

_images/setup6.png

Review Result

The result view contains a Word Cloud tab, a Context tab and a Table tab.

Word Cloud

The Word Cloud is a visualization technique that provides a stunning format for important textual data points. In general, the more a specific word appears in a source of textual data, the bigger and bolder it appears in the word cloud.

Our economic news data showed the following word cloud. It mentioned that the most mentioned word is economy, followed by interest rates, dollar, stocks etc. The appearence can be customized by Minimum Frequency and options under Customize for font size, rotation and color schema.

_images/word_cloud.png

Context

The table in Context highlights both keywords and the sentiment classification results. Actable AI would try to break down the original text into sentences and apply keyword extraction and sentiment analysis on each sentences. One can view the result as following. The ROW column means the row in original dataset, KEYWORD column contains the extracted keywords for the breakdown sentences, each sentence would contain one keyword. SENTENCE column is showing the breakdown sentences. SENTIMENT column is showing the sentiment classification result.

_images/context_view.png

Table

The Table tab display the original dataset.