hadoop jar /usr/local/hadoop-0.18.0/hadoop-0.18.0-examples.jar grep input output livedoor
08/10/27 02:31:05 WARN httpclient.HttpMethodReleaseInputStream: Released HttpMethod in finalize() as response data stream has gone out of scope. This behaviour is not guarenteed! Please close all response data streams yourself.
org.apache.hadoop.fs.s3.S3FileSystemException: Not a Hadoop S3 file.
	at org.apache.hadoop.fs.s3.Jets3tFileSystemStore.checkMetadata(Jets3tFileSystemStore.java:194)

むむ。だめすか。→ headの結果を見ると、いろいろ書けばいい模様。

$VAR1 = {
          'content_length' => '21',
          'client-response-num' => 21,
          'last-modified' => 'Mon, 27 Oct 2008 09:12:01 GMT',
          'value' => '',
          'date' => 'Mon, 27 Oct 2008 09:12:03 GMT',
          'client-peer' => '207.171.191.246:80',
          'content-length' => '21',
          'etag' => '5317293c25465d5cd660be441c185d41',
          'client-date' => 'Mon, 27 Oct 2008 09:12:02 GMT',
          'content_type' => 'binary/octet-stream',
          'x-amz-request-id' => '4C7079C46D0C1216',
          'content-type' => 'binary/octet-stream',
          'x-amz-id-2' => 'kLX4Mb1+/6739rp9cDM5Gsq1OIbJw+Z4SDqwvZrv8aFkA497/vbA9oz1t3T2t8G+',
          'server' => 'AmazonS3'
        };

$VAR1 = {
          'content_length' => '1',
          'last-modified' => 'Mon, 27 Oct 2008 06:45:08 GMT',
          'x-amz-meta-fs' => 'Hadoop',
          'date' => 'Mon, 27 Oct 2008 09:12:03 GMT',
          'client-peer' => '207.171.191.246:80',
          'client-date' => 'Mon, 27 Oct 2008 09:12:02 GMT',
          'x-amz-request-id' => 'D199F64993BD1EE1',
          'content-type' => 'binary/octet-stream',
          'x-amz-id-2' => 'cZFyIeNhjRDTmoDaz3dxMi3F7FRZ9oOLTiDPohFE4i2f+JuPhwEwdGt47FwrB8Rx',
          'server' => 'AmazonS3',
          'client-response-num' => 22,
          'x-amz-meta-fs-type' => 'block',
          'value' => '',
          'content-length' => '1',
          'etag' => '93b885adfe0da089cdf634904fd59f71',
          'content_type' => 'binary/octet-stream',
          'x-amz-meta-fs-version' => '1'
        };

• x-amz-meta-fs
• x-amz-meta-fs-type
• x-amz-meta-fs-version ですかな。 →うむ。hadoop側から読めるようになった！→ということでcpanにうpした！