当前位置:首页 > 操作系统 > Windows

windows下用Eclipse连接大数据环境得hbase

1、解压hbase安装包

2、将大数据环境得hadoop安装包拷贝到windows(这里以d:/hadoop为例)

3、打开C:WindowsSystem32driversetc目录下的hosts并添加如下代码

127.0.0.1 localhost
192.168.48.134 master
192.168.48.133 slaver

注:这里你配置了几台服务器就写几台,这里我只配置192.168.48.134 master和192.168.48.133 slaver两台

4、使用Eclipse创建一个java工程,引进第一步骤中解压Hbase文件夹下的lib里面的全部jar

5、最好也在src下面创建一个文件夹,并把集群环境中hbase的hbase-site.xml放入文件文件夹中,并添加到class path中(其实新版本的都可省略这步了,因为我的hadoop是2.7.3,hbase用的是1.2.4算是比较高度版本了)

6、在步骤二的文件夹的bin文件夹下是否有winutils.exe文件,如果没有的话,就下载一个放在该目录

7、示例代码:

            <span>import</span>
            <span> java.io.IOException;

</span>
            <span>import</span>
            <span> org.apache.hadoop.conf.Configuration;
</span>
            <span>import</span>
            <span> org.apache.hadoop.fs.Path;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.HBaseConfiguration;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.HColumnDescriptor;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.HConstants;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.HTableDescriptor;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.TableName;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.client.Admin;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.client.Connection;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.client.ConnectionFactory;
</span>
            <span>import</span>
            <span> org.apache.hadoop.hbase.io.compress.Compression.Algorithm;

</span>
            <span>public</span>
            <span>class</span>
            <span> TestHbase {

  </span>
            <span>private</span>
            <span>static</span>
            <span>final</span> String TABLE_NAME = "test"<span>;
  </span><span>private</span><span>static</span><span>final</span> String CF_DEFAULT = "info"<span>;

  </span><span>public</span><span>static</span><span>void</span> createOrOverwrite(Admin admin, HTableDescriptor table) <span>throws</span><span> IOException {
    </span><span>if</span><span> (admin.tableExists(table.getTableName())) {
      admin.disableTable(table.getTableName());
      admin.deleteTable(table.getTableName());
    }
    admin.createTable(table);
  }

  </span><span>public</span><span>static</span><span>void</span> createSchemaTables(Configuration config) <span>throws</span><span> IOException {
    </span><span>try</span> (Connection connection =<span> ConnectionFactory.createConnection(config);
         Admin admin </span>=<span> connection.getAdmin()) {

      HTableDescriptor table </span>= <span>new</span><span> HTableDescriptor(TableName.valueOf(TABLE_NAME));
      table.addFamily(</span><span>new</span><span> HColumnDescriptor(CF_DEFAULT).setCompressionType(Algorithm.NONE));

      System.out.print(</span>"Creating table. "<span>);
      createOrOverwrite(admin, table);
      System.out.println(</span>" Done."<span>);
    }
  }

  </span><span>public</span><span>static</span><span>void</span> main(String[] args) <span>throws</span><span> IOException {  
        Configuration config </span>=<span> HBaseConfiguration.create();  
  
        </span><span>/*</span><span> 
        * 默认会从项目编译后的calss文件的根目录寻找文件,可以不指定 
        * 添加资源文件有以下几种方式: 
        * </span><span>*/</span><span>/**</span><span> 
         * config.addResource(input); 
         </span><span>*/</span><span>//</span><span>InputStream input = HBaseOper.class.getResourceAsStream("/core-site.xml");  
        </span><span>//</span><span>config.addResource(input);  </span><span>/**</span><span> 
         * 官网给出的例子程序使用的是这种方法 
         * config.addResource(Path); 
         * Path可以为绝对路径,例如:D:Program Fileshbaseconfhbase-site.xml 
         </span><span>*/</span><span><br />      //这里就是步骤二从集群环境拷过来的hadoop放在window上的路径,注意都是用的绝对路径
        System.setProperty(</span>"hadoop.home.dir", "D:UserszmlEclipsehadoop-2.7.3"<span>);
        </span><span>//</span><span>Add any necessary configuration files (hbase-site.xml, core-site.xml)  <br />    //这些文件都是从集群环境上拷过来的<br /></span>
        config.addResource(<span>new</span> Path("D:UserszmlEclipseworkspaceHbaseDemohbase_confhbase-site.xml"<span>));  
        config.addResource(</span><span>new</span> Path("D:UserszmlEclipseworkspaceHbaseDemohbase_confcore-site.xml"<span>));  
        createSchemaTables(config);  
        </span><span>//</span><span>modifySchema(config);  </span><span>    }  
}  </span>

 

原文:http://www.cnblogs.com/zml-java/p/6559929.html


【说明】本文章由站长整理发布,文章内容不代表本站观点,如文中有侵权行为,请与本站客服联系(QQ:254677821)!

相关教程推荐

其他课程推荐