the problem was this:
# modprobe ip_tables
FATAL: Error inserting iptables (/lib/modules/2.6.32.11-svn52288/kernel/net/ipv4/netfilter/ip_tables.ko): Invalid module format
it happened because you skipped steps during module compilation instead of make modules and make modules_install you should have do:
make prepare
make scripts
make
make modules_prepare
make modules
make modules_install
depmod -a
and then the iptables module loads fine and iptables works fine, while minimizing the risk of bricking your nas
i tested just the filter table on mybook live 02.42.03-027 and it works without errors.