java - JMeter Recording Controller 记录不同格式的请求

Question

我开发了一个使用 Apache-JMeter 的网络爬虫。

我创建了一个记录 Controller 来将请求/响应记录为 jmx 树。

要记录 jmx，我有两种选择，要么在我的代码中集成 JMeter api，要么使用 JMeter GUI，我选择两者进行测试。所以我从代码和 gui 运行 apache-jmeter 来并排记录请求/响应。下面是一个请求的Code-Base-JMeter和GUI-Base-JMeter的jmx结果

代码库-JMeter

<HTTPSamplerProxy guiclass="HttpTestSampleGui" testname="19 /rural-property-for-sale/yorkshire/north-yorkshire/holmeonspaldingmoor-26186193/" enabled="true">
          <elementProp name="HTTPsampler.Arguments" elementType="Arguments">
            <collectionProp name="Arguments.arguments"/>
          </elementProp>
          <stringProp name="HTTPSampler.implementation">HttpClient4</stringProp>
          <boolProp name="HTTPSampler.follow_redirects">true</boolProp>
          <boolProp name="HTTPSampler.use_keepalive">false</boolProp>
          <stringProp name="HTTPSampler.domain">www.uklandandfarms.co.uk</stringProp>
          <stringProp name="HTTPSampler.method">GET</stringProp>
          <stringProp name="HTTPSampler.port">0</stringProp>
          <stringProp name="HTTPSampler.protocol">http</stringProp>
          <stringProp name="HTTPSampler.path">/rural-property-for-sale/yorkshire/north-yorkshire/holmeonspaldingmoor-26186193/</stringProp>
          <elementProp name="HTTPSampler.header_manager" elementType="HeaderManager" guiclass="HeaderPanel" testclass="HeaderManager" testname="HTTP Header Manager" enabled="true">
            <collectionProp name="HeaderManager.headers">
              <elementProp name="Cache-Control" elementType="Header">
                <stringProp name="Header.name">Cache-Control</stringProp>
                <stringProp name="Header.value">no-cache</stringProp>
              </elementProp>
              <elementProp name="Accept-Encoding" elementType="Header">
                <stringProp name="Header.name">Accept-Encoding</stringProp>
                <stringProp name="Header.value">gzip</stringProp>
              </elementProp>
              <elementProp name="Pragma" elementType="Header">
                <stringProp name="Header.name">Pragma</stringProp>
                <stringProp name="Header.value">no-cache</stringProp>
              </elementProp>
              <elementProp name="User-Agent" elementType="Header">
                <stringProp name="Header.name">User-Agent</stringProp>
                <stringProp name="Header.value">Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.112 Safari/535.1</stringProp>
              </elementProp>
              <elementProp name="Accept" elementType="Header">
                <stringProp name="Header.name">Accept</stringProp>
                <stringProp name="Header.value">text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2</stringProp>
              </elementProp>
            </collectionProp>
          </elementProp>
          <boolProp name="HTTPSampler.auto_redirects">false</boolProp>
          <boolProp name="HTTPSampler.image_parser">true</boolProp>
        </HTTPSamplerProxy>

GUI-Base-JMeter

      <HTTPSamplerProxy guiclass="HttpTestSampleGui" testclass="HTTPSamplerProxy" testname="32 /" enabled="true">
        <elementProp name="HTTPsampler.Arguments" elementType="Arguments" guiclass="HTTPArgumentsPanel" testclass="Arguments" enabled="true">
          <collectionProp name="Arguments.arguments"/>
        </elementProp>
        <stringProp name="HTTPSampler.domain">www.uklandandfarms.co.uk</stringProp>
        <stringProp name="HTTPSampler.port"></stringProp>
        <stringProp name="HTTPSampler.protocol">http</stringProp>
        <stringProp name="HTTPSampler.contentEncoding">utf-8</stringProp>
        <stringProp name="HTTPSampler.path">/</stringProp>
        <stringProp name="HTTPSampler.method">GET</stringProp>
        <boolProp name="HTTPSampler.follow_redirects">true</boolProp>
        <boolProp name="HTTPSampler.auto_redirects">false</boolProp>
        <boolProp name="HTTPSampler.use_keepalive">true</boolProp>
        <boolProp name="HTTPSampler.DO_MULTIPART_POST">false</boolProp>
        <boolProp name="HTTPSampler.image_parser">true</boolProp>
        <stringProp name="HTTPSampler.embedded_url_re"></stringProp>
        <stringProp name="HTTPSampler.implementation">HttpClient4</stringProp>
        <stringProp name="HTTPSampler.connect_timeout"></stringProp>
        <stringProp name="HTTPSampler.response_timeout"></stringProp>
      </HTTPSamplerProxy>
      <hashTree>
        <HeaderManager guiclass="HeaderPanel" testclass="HeaderManager" testname="HTTP Header Manager" enabled="true">
          <collectionProp name="HeaderManager.headers">
            <elementProp name="Accept-Language" elementType="Header">
              <stringProp name="Header.name">Accept-Language</stringProp>
              <stringProp name="Header.value">en-GB,en;q=0.5</stringProp>
            </elementProp>
            <elementProp name="Upgrade-Insecure-Requests" elementType="Header">
              <stringProp name="Header.name">Upgrade-Insecure-Requests</stringProp>
              <stringProp name="Header.value">1</stringProp>
            </elementProp>
            <elementProp name="Accept-Encoding" elementType="Header">
              <stringProp name="Header.name">Accept-Encoding</stringProp>
              <stringProp name="Header.value">gzip, deflate</stringProp>
            </elementProp>
            <elementProp name="User-Agent" elementType="Header">
              <stringProp name="Header.name">User-Agent</stringProp>
              <stringProp name="Header.value">Mozilla/5.0 (Windows NT 10.0; WOW64; rv:54.0) Gecko/20100101 Firefox/54.0</stringProp>
            </elementProp>
            <elementProp name="Accept" elementType="Header">
              <stringProp name="Header.name">Accept</stringProp>
              <stringProp name="Header.value">text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8</stringProp>
            </elementProp>
          </collectionProp>
        </HeaderManager>
        <hashTree/>
      </hashTree>

录音之间的差异

1) HTTPSamplerProxy 树在 GUI-Base-JMeter 重新编码的 header 部分之前结束，而 HTTPSamplerProxy 树在 Code- 的最后结束基础JMeter

2) HeaderManager 在GUI-Base-JMeter 中是标签，而在Code-Base-JMeter 中是elementProp 标签的属性值。

3) HeaderManager 是 GUI-Base-JMeter 中 HTTPSamplerProxy 的兄弟，而 elementProp 标签(属于 HeaderManager property-value) 是 HTTPSamplerProxy 的子级。

两个录音的整体布局基本上是不同的。我希望 Code-Base-JMeter 记录与 GUI-Base-JMeter 重新编码相同。

我正在使用 Apache-JMeter 3.2(用于 GUI 和代码)

下面是代码

初始化

    public void init(Integer port) throws Exception {

        JMeterUtils.setJMeterHome(Constants.JMETER_HOME);
        JMeterUtils.loadJMeterProperties(JMeterUtils.getJMeterBinDir() + "/jmeter.properties");
        JMeterUtils.initLocale();

        LoopController loopController = new LoopController();
        loopController.setEnabled(true);
        loopController.setLoops(1);

        RecordingController rc = new RecordingController();
        rc.setName("Recording Controller");

        TestPlan testPlan = new TestPlan();

        ThreadGroup threadGroup1 = new ThreadGroup();
        threadGroup1.setSamplerController(loopController);
        threadGroup1.addTestElement(rc); // Target

        ListedHashTree testPlanTree = new ListedHashTree();
        testPlanTree.add(testPlan);
        testPlanTree.add(threadGroup1, testPlan);

        this.treeModel = new JMeterTreeModel(new Object());

        JMeterTreeNode root = (JMeterTreeNode) treeModel.getRoot();
        treeModel.addSubTree(testPlanTree, root);

        proxy = new ProxyControl();
        proxy.setNonGuiTreeModel(treeModel);
        proxy.setTarget(treeModel.getNodeOf(threadGroup1));
        proxy.setGroupingMode(2); // GROUPING_IN_SIMPLE_CONTROLLERS = 2
//      proxy.setGroupingMode(3); // GROUPING_STORE_FIRST_ONLY = 3
        proxy.setSamplerTypeName("2"); // SAMPLER_TYPE_HTTP_SAMPLER_HC4 = "2"
        proxy.setRegexMatch(Boolean.TRUE);
        proxy.setPort(port); // Global Settings -> Port
        proxy.setCaptureHttpHeaders(Boolean.TRUE);
        proxy.setSamplerFollowRedirects(Boolean.TRUE);
//      proxy.setSamplerRedirectAutomatically(Boolean.TRUE);
        proxy.setSamplerDownloadImages(Boolean.TRUE);

        treeModel.addComponent(proxy, (JMeterTreeNode) root.getChildAt(1));
    }

启动JMeter

this.proxy.startProxy();

停止/记录 JMeter

/**
 * The method stop() is use to stop JMeter recording controller proxy.
 * 
 * @return The tree that is recorded till now
 */
public String stop() {

    OutputStream out = null;

    try {
        this.proxy.stopProxy();

        if (this.treeModel == null) {
            return null;
        }

        out = new ByteArrayOutputStream();

        HashTree tree = treeModel.getTestPlan();

        JMeter.convertSubTree(tree);

        SaveService.saveTree(tree, out);
    } catch (Exception e) {
        return null;
    }

    return out.toString();
}

Answer 1

警告:这不是合法的解决方案/答案，它只是一种解决方法，因为还没有人给我任何解决方案。

我制作了一个 xslt 表达式来将 Code-Base-JMeter-Jmx 转换为 Gui-Base-JMeter-Jmx

<?xml version="1.0" encoding="UTF-8"?>
<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">
    <xsl:output omit-xml-declaration="yes" indent="yes" />
    <xsl:strip-space elements="*" />
    <xsl:template match="/">
        <xsl:apply-templates />
        <hashTree>
            <HeaderManager guiclass="HeaderPanel" testclass="HeaderManager" testname="HTTP Header Manager" enabled="true">
                <xsl:copy-of select="HTTPSamplerProxy/elementProp[@elementType = 'HeaderManager']/collectionProp[@name='HeaderManager.headers']" />
            </HeaderManager>
            <hashTree />
        </hashTree>
    </xsl:template>
    <xsl:template match="HTTPSamplerProxy/elementProp[@elementType = 'HeaderManager']" />
    <xsl:template match="@*|node()">
        <xsl:copy>
            <xsl:apply-templates select="@*|node()" />
        </xsl:copy>
    </xsl:template>
</xsl:stylesheet>

现在，如果在 JMeter 的下一个版本中他们更改了 jmx/xml 输出，那么我必须再次更改我的 xslt 以适应更改，这根本不是一个好方法。

所以我仍然渴望有一个合法的解决方案。