Name

• TFS module

Description

• This module implements an asynchronous client of TFS(Taobao File System), providing RESTful API to it. TFS is a distributed file system developed by Taobao Inc.

This module is not built by default, it should be enabled with the --with-http_tfs_module configuration parameter.

Example

http {
    #tfs_upstream tfs_rc {
    #    server 127.0.0.1:6100;
    #    type rcs;
    #    rcs_zone name=tfs1 size=128M;
    #    rcs_interface eth0;
    #    rcs_heartbeat lock_file=/logs/lk.file interval=10s;
    #}

    tfs_upstream tfs_ns {
        server 127.0.0.1:8108;
        type ns;
    }

    server {
          listen       7500;
          server_name  localhost;

          tfs_keepalive max_cached=100 bucket_count=10;
          tfs_log "pipe:/usr/sbin/cronolog -p 30min /path/to/nginx/logs/cronolog/%Y/%m/%Y-%m-%d-%H-%M-tfs_access.log";

          location / {
              tfs_pass tfs://tfs_ns;
          }
    }
}

Directives

tfs_upstream

Syntax： tfs_upstream name {...}

Default： none

Context： http

Defines information of upstream TFS server.

Example:

tfs_upstream tfs_rc {
    server 127.0.0.1:6100;
    type rcs;
    rcs_zone name=tfs1 size=128M;
    rcs_interface eth0;
    rcs_heartbeat lock_file=/logs/lk.file interval=10s;
}

tfs_upstream tfs_ns {
    server 127.0.0.1:8100;
    type ns;
}

server

Syntax： server address

Default： none

Context： tfs_upstream

Defines the address of upstream TFS server. An address can be specified as a domain name or IP address.

Example :

server 10.0.0.1:8108;

type

Syntax： type [ns | rcs]

Default： ns

Context： tfs_upstream

Specify the type of upstream TFS server. It could be ns(NameServer) or rcs(RcServer), default is ns.

rcs_zone

Syntax： rcs_zone name=n size=num

Default： none

Context： tfs_upstream

Defines the shared memory zone used to store application configuration information registerd in RcServer. This directive is mandatory when upstream is RcServer. Application configuration information can be updated through heartbeat with RcServer(directive <i>rcs_heartbeat</i>).

Example:

rcs_zone name=tfs1 size=128M;

rcs_heartbeat

Syntax： rcs_heartbeat lock_file=/path/to/file interval=time

Default： none

Context： tfs_upstream

Enable heartbeat with RcServer so that application configuration information can be updated in time. It is mandatory when upstream is RcServer.

The following parameters must be defined:

lock_file=<i>/path/to/file</i> use to create a mutex so that only one Nginx worker can do heartbeat at one time. interval=<i>time</i> set heartbeat interval.

Example:

rcs_heartbeat lock_file=/path/to/nginx/logs/lk.file interval=10s;

rcs_interface

Syntax： rcs_interface interface

Default： none

Context： tfs_upstream

Specify net interface used by TFS module. It is used to get local IP address. It is only mandatory when upstream is RCServer.

Example:

rcs_interface eth0;

tfs_pass

Syntax： tfs_pass name

Default： none

Context： location

Specify TFS upstream. Remember that protocol used here must be "tfs".

Example:

tfs_upstream tfs_rc {
};

location / {
	tfs_pass tfs://tfs_rc;
}

tfs_keepalive

Syntax： tfs_keepalive max_cached=num bucket_count=num

Default： none

Context： http, server

Defines connection pool used by TFS module. This connection pool caches upstream connections.

The following parameters must be defined:

max_cached=<i>num</i> set the capacity of one hash bucket. bucket_count=<i>num</i> set the count of hash buckets.

Example:

tfs_keepalive max_cached=100 bucket_count=15;

tfs_block_cache_zone

Syntax： tfs_block_cache_zone size=num

Default： none

Context： http

Defines the shared memory zone used for BlockCache.

Example:

tfs_block_cache_zone size=256M;

tfs_log

Syntax： tfs_log path

Default： none

Context： http, server

Sets the TFS access log.

Example:

tfs_log "pipe:/usr/sbin/cronolog -p 30min /path/to/nginx/logs/cronolog/%Y/%m/%Y-%m-%d-%H-%M-tfs_access.log";

tfs_body_buffer_size

Syntax： tfs_body_buffer_size size

Default： 2m

Context： http, server, location

Sets the buffer size for reading upstream response. By default, buffer size is 2m.

Example:

tfs_body_buffer_size 2m;

tfs_connect_timeout

Syntax： tfs_connect_timeout time

Default： 3s

Context： http, server, location

Sets a timeout for connecting upstream servers.

tfs_send_timeout

Syntax： tfs_send_timeout time

Default： 3s

Context： http, server, location

Sets a timeout for transmitting data to upstream servers.

tfs_read_timeout

Syntax： tfs_read_timeout time

Default： 3s

Context： http, server, location

Sets a timeout for reading data from upstream servers.

Others

Uploading file size supported depends on the directive <i>client_max_body_size</i>.