Pig Filter Usage Example

Filter: Filters data, only data that meets certain criteria is preserved and then goes to the next data stream.

1) equivalent comparison

Filter data by $ = = 1filter data by $ = 1

2) Regular expression of string regex matching JavaString starts with cm

Filter data by $ matches ' cm.* ';

String contains cm

Filter data by $ matches '. *cm.* ';

3) not

Filter data by isn't $0==1;filter data by not matches '. *cm.* ';

　　

4) NULL handling

Filter data by $ are not null;

　　

5) UDF

Filter data by Isvalidate ($);

　　

6) and or

Filter data by $0!=1 and $1>10

　　

Pig Filter Usage Example