json - jq 迭代和条件

标签 json linux bash jq

我有一些需要使用 jq 解析的 json。我正在尝试提取 SecurityGroups>GroupId 如果任何 SecurityGroups>IpPermissions>IpRanges>CidrIp 匹配某个 IP。

例如,搜索 11.11.11.11 应该返回 sg-3jf32kj3j。有可能多个安全组将包含该 IP。我需要返回每个 GroupId。

这甚至可以单独使用 jq 还是需要 bash?

与仅使用 Python 之类的东西相比,我发现 jq 语法令人困惑。

{
"SecurityGroups": [{
        "OwnerId": "111111111",
        "Description": "default VPC security group",
        "GroupId": "sg-1a1a1a1a1",
        "VpcId": "vpc-1a1a1a1a1",
        "IpPermissionsEgress": [{
            "IpProtocol": "-1",
            "PrefixListIds": [],
            "Ipv6Ranges": [],
            "UserIdGroupPairs": [],
            "IpRanges": [{
                "CidrIp": "0.0.0.0/0"
            }]
        }],
        "GroupName": "default",
        "IpPermissions": [{
            "IpProtocol": "-1",
            "PrefixListIds": [],
            "Ipv6Ranges": [],
            "UserIdGroupPairs": [{
                "GroupId": "sg-5df45d5d5",
                "UserId": "234234234"
            }],
            "IpRanges": []
        }]
    },
    {
        "OwnerId": "22222222222",
        "Description": "EC2 Security Group",
        "Tags": [{
                "Key": "aws:cloudformation:logical-id",
                "Value": "EC2SecurityGroup"
            },
            {
                "Key": "aws:cloudformation:stack-id",
                "Value": "arn:aws:cloudformation:us-west-2:111111111:stack/blah-prod-vpc/asdfsdf-j3j3-22j1-39fj-sadfsadf"
            },
            {
                "Key": "Name",
                "Value": "blah-production-EC2"
            },
            {
                "Key": "Owner",
                "Value": "blah@blah.com"
            },
            {
                "Key": "aws:cloudformation:stack-name",
                "Value": "prod-vpc"
            },
            {
                "Key": "Created",
                "Value": "2018-05-21T09:40:55-07:00"
            }
        ],
        "GroupId": "sg-3jf32kj3j",
        "VpcId": "vpc-3kj3f2kj3",
        "IpPermissionsEgress": [{
            "IpProtocol": "-1",
            "PrefixListIds": [],
            "Ipv6Ranges": [],
            "UserIdGroupPairs": [],
            "IpRanges": [{
                "CidrIp": "0.0.0.0/0"
            }]
        }],
        "GroupName": "blah-prod-vpc-EC2SecurityGroup-SJHS78F78SSH",
        "IpPermissions": [{
                "IpProtocol": "tcp",
                "ToPort": 80,
                "UserIdGroupPairs": [],
                "IpRanges": [{
                    "CidrIp": "0.0.0.0/0"
                }],
                "FromPort": 80,
                "PrefixListIds": [],
                "Ipv6Ranges": []
            },
            {
                "IpProtocol": "icmp",
                "ToPort": 0,
                "UserIdGroupPairs": [],
                "IpRanges": [{
                    "CidrIp": "11.11.11.11/32"
                }],
                "FromPort": 0,
                "PrefixListIds": [],
                "Ipv6Ranges": []
            },
            {
                "IpProtocol": "-1",
                "PrefixListIds": [],
                "Ipv6Ranges": [],
                "UserIdGroupPairs": [],
                "IpRanges": [{
                        "CidrIp": "22.22.22.22/16"
                    },
                    {
                        "CidrIp": "33.33.33.33/32"
                    }
                ]
            },
            {
                "IpProtocol": "tcp",
                "ToPort": 22,
                "UserIdGroupPairs": [],
                "IpRanges": [{
                    "CidrIp": "0.0.0.0/0"
                }],
                "FromPort": 22,
                "PrefixListIds": [],
                "Ipv6Ranges": [{
                    "CidrIpv6": "::/0"
                }]
            },
            {
                "IpProtocol": "tcp",
                "ToPort": 443,
                "UserIdGroupPairs": [],
                "IpRanges": [{
                    "CidrIp": "0.0.0.0/0"
                }],
                "FromPort": 443,
                "PrefixListIds": [],
                "Ipv6Ranges": []
            },
            {
                "IpProtocol": "icmp",
                "ToPort": -1,
                "UserIdGroupPairs": [],
                "IpRanges": [{
                        "CidrIp": "44.44.44.44/32"
                    },
                    {
                        "CidrIp": "55.55.55.55/29"
                    }
                ],
                "FromPort": -1,
                "PrefixListIds": [],
                "Ipv6Ranges": []
            }
        ]
    }
]}

最佳答案

以下过滤器满足规定的要求:

.SecurityGroups[]
| select( any(.IpPermissions[].IpRanges[];
              .CidrIp | startswith("11.11.11.11/") ) )
| .GroupId

特别是,根据您的输入,它会产生所需的值:

"sg-3jf32kj3j"

您可能想要考虑更复杂的模式匹配,也许使用:

test("^11.11.11.11($|/)")

如果要去掉引号,可以考虑使用jq的-r命令行选项。

使用..

这是另一个解决方案,但请注意它具有完全不同的语义:

..
| select( .. |  test("^11.11.11.11($|/)")? )
| .GroupId? // empty

关于json - jq 迭代和条件,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/54353243/

相关文章:

json - 生成器 - thunkifying JSON.parse 返回奇怪的结果

服务器上的 java.lang.ClassNotFoundException : com. twilio.sdk.TwilioRestException

java - IOException:关闭文件流时权限被拒绝

bash - 无缘无故的shell脚本问题

Python 请求向 JSON 文件添加 token

python - 从字典中将指定的键值加载到 json 对象中

android - optjson 和 getjson 有什么区别?

Linux 查找子目录中的所有文件并 move 它们

linux - 如何暂停和恢复 Bash 中的一系列命令?

java - 如何从 bash 脚本指定工作目录