-- Logs begin at Wed 2022-05-25 13:53:10 UTC, end at Wed 2022-05-25 15:30:23 UTC. -- May 25 14:45:10.810529 dv-cinder-830283-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 14:45:10.819891 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:45:10 2022] *** May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: nodename: dv-cinder-830283-3-iscsi May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: machine: x86_64 May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: clock source: unix May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: pcre jit disabled May 25 14:45:10.821844 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: detected number of CPU cores: 4 May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: current working directory: / May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: detected binary path: /usr/bin/uwsgi-core May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: your processes number limit is 47680 May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: your memory page size is 4096 bytes May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: detected max file descriptor number: 2048 May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: lock engine: pthread robust mutexes May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: thunder lock: enabled May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 14:45:10.822456 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:45:10.865965 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: Python main interpreter initialized at 0x5623aac149c0 May 25 14:45:10.865965 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: python threads support enabled May 25 14:45:10.865965 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: your server socket listen backlog is limited to 100 connections May 25 14:45:10.865965 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: your mercy for graceful operations on workers is 90 seconds May 25 14:45:10.866309 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:45:10.866382 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: *** Operational MODE: preforking *** May 25 14:45:10.866653 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: *** uWSGI is running in multiple interpreter mode *** May 25 14:45:10.866653 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: spawned uWSGI master process (pid: 115451) May 25 14:45:10.866848 dv-cinder-830283-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 14:45:10.867606 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: spawned uWSGI worker 1 (pid: 115452, cores: 1) May 25 14:45:10.867705 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: spawned uWSGI worker 2 (pid: 115453, cores: 1) May 25 14:45:10.868254 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:45:12.026035 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:45:12.031854 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:45:12.744951 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:45:12.744951 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: from cryptography.utils import int_from_bytes May 25 14:45:12.745286 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:45:12.745286 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: from cryptography.utils import int_from_bytes May 25 14:45:12.747560 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:45:12.747560 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: from cryptography.utils import int_from_bytes May 25 14:45:12.747895 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:45:12.747895 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: from cryptography.utils import int_from_bytes May 25 14:45:15.351280 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:45:15.351845 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:45:15.352076 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:45:15.352438 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:45:15.352692 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:45:15.353078 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.353404 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.353598 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:45:15.353969 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.354067 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:45:15.354155 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.354358 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.354459 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:45:15.354671 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.354803 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:45:15.354993 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.355092 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:45:15.355311 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.355399 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.355635 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.355723 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.355893 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356013 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356206 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356334 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356531 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-3-iscsi {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356692 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356851 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.356970 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.357155 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.357297 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.357463 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.357620 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.357776 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.357951 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.358076 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.358214 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.358395 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.358535 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.358719 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.358897 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-3-iscsi {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.359214 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.359336 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.359525 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.359661 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.359837 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.359952 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.360155 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.360270 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.360581 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.360826 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.360966 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.361050 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.361761 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.361850 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.362089 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.362346 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.362479 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.362682 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.362790 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.362994 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.363096 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.363308 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.363426 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-3-iscsi {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.363646 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.363763 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.363992 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.364086 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.364286 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.364378 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.364611 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.364699 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.364894 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.365083 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.365220 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.365391 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.365529 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.365710 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.365928 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-3-iscsi {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366037 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366250 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366358 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366563 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366678 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366904 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.366997 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.367277 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.367379 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.367593 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.367678 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.367895 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368003 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368200 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368302 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368506 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368592 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368840 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.368925 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.369127 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.369229 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.369425 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.369516 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370062 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370160 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370254 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370333 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370400 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370476 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370697 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370873 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.370996 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371092 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371173 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371289 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371410 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371596 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371727 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.371904 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372054 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372148 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372361 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372469 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372664 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372752 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.372967 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373117 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373272 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373369 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373574 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373661 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373860 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.373954 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.374165 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.374252 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.374467 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.374553 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.374808 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.374900 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.375119 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.375216 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.375427 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.375514 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.375755 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.375865 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.376029 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.376115 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.376337 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.376423 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.376644 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.377373 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.377533 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.377623 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.377856 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.377943 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.378174 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.378270 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.378498 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.378586 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.378833 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.378921 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.379152 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.379251 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.379460 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.379547 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.379764 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.379852 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.380067 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.380167 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.380382 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.380482 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.380703 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.380804 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381005 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381093 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381254 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381340 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381553 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381640 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381859 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.381947 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.382174 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.382266 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.382475 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.382565 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.382800 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.382902 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.383104 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.383199 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.383404 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.383580 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.383743 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.383919 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384049 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384236 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384351 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384544 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384652 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384866 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.384952 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.385173 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.385260 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.385481 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.385568 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.385787 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.385873 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.386091 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.386176 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.386399 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.386486 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.386727 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.386828 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387036 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387123 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387342 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387430 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387650 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387740 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.387956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388045 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388264 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388351 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388562 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388649 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388864 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.388950 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.389177 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.389264 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.389480 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.389566 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.389781 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.389880 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.390084 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.390169 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.390382 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.390467 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.390704 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.390794 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391019 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391116 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391316 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391402 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391618 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391720 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.391938 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392025 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392238 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392355 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392575 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392676 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392874 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.392961 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.393174 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.393262 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.393471 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.393566 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.393770 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.393856 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394067 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394161 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394364 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394460 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394676 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394779 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.394996 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395082 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395300 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395387 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395603 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395695 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395904 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.395998 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.396202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.396290 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.396503 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.396587 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.396808 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.396893 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.397111 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.397198 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.397411 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.397497 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.397731 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.397816 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.398052 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.398146 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.398367 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.398453 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.398699 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.398807 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.399010 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.399095 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.399320 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.399474 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:45:15.399644 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.399740 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.399948 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400043 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400254 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400341 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400561 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400657 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400875 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.400969 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.401187 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.401273 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.401511 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.401600 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.401827 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.401914 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.402138 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.402224 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.402449 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.402538 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.402780 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.402880 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.403091 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.403179 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.403403 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.403490 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.403718 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.403813 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.404024 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.404119 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.404364 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.404543 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.404740 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.404872 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.405053 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.405194 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.405375 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.405514 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.405695 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.405827 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406005 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406145 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406312 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406476 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406621 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406829 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.406963 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.407147 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.407299 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.407494 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.407692 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.407837 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.408069 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.408197 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.408382 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.408529 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.408692 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.408856 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409001 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409172 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409310 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409491 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409610 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409805 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.409938 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.410130 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.410250 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.410467 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.410552 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.410811 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.410899 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.411138 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.411226 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.411453 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.411538 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.411771 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.411872 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412081 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412166 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412384 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412479 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412685 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412795 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.412988 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.413086 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.413291 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.413377 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.413591 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.413686 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.413907 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414229 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414322 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414531 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414626 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414868 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.414952 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.415179 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.415275 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.415483 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.415577 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.415787 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.415870 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.416092 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.416183 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.416390 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.416476 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.416697 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.416782 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417000 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417083 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417301 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417395 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417620 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417706 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.417926 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418019 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418230 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418317 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418547 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418667 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418872 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.418967 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.419174 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.419260 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.419483 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.419631 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.419788 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.419887 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.420093 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.420181 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.420399 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.420494 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.420704 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.420805 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421022 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421108 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421328 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421414 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421637 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421740 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.421944 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.422038 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.422253 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.422340 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.422572 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.422700 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.422912 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.423001 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.423226 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.423324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.423537 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.424125 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.424367 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.424456 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.424676 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.424763 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.424978 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425118 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425279 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425366 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425674 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425884 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.425976 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.426209 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.426477 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.426564 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.426834 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.426925 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.427134 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.427219 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.427435 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.427522 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.427755 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.427846 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428064 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428165 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428361 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428450 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428661 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428750 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.428960 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.429047 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.429267 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.429376 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.429575 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.429702 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.429869 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430006 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430174 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430344 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430480 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430675 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430810 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.430993 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.431137 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.431303 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.431448 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.431618 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.431756 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.431927 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.432061 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.432238 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.432366 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.432544 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.432710 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.432850 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.433018 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.433166 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.433361 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.433457 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.433699 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.433786 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.434025 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.434113 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.434353 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.434439 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.434689 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.434818 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435009 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435117 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435312 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435422 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435622 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435716 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.435938 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436026 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436253 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436339 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436574 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436679 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436885 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.436973 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.437189 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.437275 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.437499 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.437594 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.437804 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.437892 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.438115 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.438221 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.438422 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.438528 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.438750 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.438859 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.439063 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.439156 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.439914 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440023 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440232 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440327 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440540 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440641 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440860 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.440964 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.441167 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.441261 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.441480 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.441576 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.441782 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.441895 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.442089 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.442193 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.442400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.442494 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.442735 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.442832 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.443050 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.443147 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.443359 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.443466 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.443674 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.443923 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444013 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444091 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444272 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444368 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444681 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444880 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.444975 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.445180 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.445276 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.445521 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.445694 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.445834 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.446030 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.446142 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.446368 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.446473 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.446763 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.446862 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447071 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447159 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447376 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447465 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447676 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447764 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.447976 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448072 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448283 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448373 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448604 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448699 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448911 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.448999 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.449228 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.449317 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.449546 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.449633 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.449848 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.449950 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.450150 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.450249 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.450467 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.450555 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.450801 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.450905 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.451105 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.451194 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.451407 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.451502 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.451707 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.451808 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.452045 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.452142 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.452611 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.452709 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.452914 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453012 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453227 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453315 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453544 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453633 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453850 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.453944 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.454158 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.454246 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.454460 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.454545 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.454788 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.454993 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.455126 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.455213 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.455433 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.455519 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.455735 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.455825 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456044 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456132 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456348 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456436 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456654 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456760 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.456959 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457050 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457275 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457362 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457580 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457675 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457884 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.457972 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.458191 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.458288 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.458492 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.458582 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.458824 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.458925 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.459136 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.459238 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.459528 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.459718 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.459843 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460051 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460173 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460385 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460472 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460670 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460757 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.460985 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.461075 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.461302 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.461391 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.461633 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.461720 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.461957 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.462062 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.462268 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.462355 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.462582 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.462717 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.462916 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.463011 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.463219 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.463490 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.463586 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.463818 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.463905 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.464122 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.464222 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.464424 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.464513 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.464726 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.464813 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465031 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465131 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465331 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465419 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465630 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465725 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.465931 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466036 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466231 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466328 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466540 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466629 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466866 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.466998 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.467174 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.467264 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.467474 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.467570 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.467794 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.467881 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468100 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468196 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468401 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468540 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468698 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468796 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.468996 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.469091 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.469307 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.469405 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.469616 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.469724 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.469923 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.470010 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.470247 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.470376 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.471131 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.471247 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.471439 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.471533 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.471746 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.471841 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472071 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472184 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472370 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472458 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472677 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472764 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.472977 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473066 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473280 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473367 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473582 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473681 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473882 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.473971 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.474188 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.474275 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.474492 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.474587 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.474825 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.474924 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.475134 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.475222 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.475434 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.475529 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.475759 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.475895 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476037 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476125 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476347 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476444 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476650 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476737 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.476950 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477074 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477249 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477352 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477553 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477642 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477855 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.477942 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.478155 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.478256 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.478459 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.478547 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.478781 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.478880 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479094 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479196 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479394 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479482 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479693 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479781 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.479993 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480296 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480414 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480600 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480689 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480896 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.480983 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.481204 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.481298 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.481509 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.481595 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.481810 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.481898 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.482107 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.482193 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.482412 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.482498 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.482740 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.482831 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483040 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483129 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483346 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483442 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483652 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483747 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.483959 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484046 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484258 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484425 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484560 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484647 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484856 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.484942 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.485154 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.485255 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.485454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.485542 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.485757 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.485846 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.486073 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.486738 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.486926 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487014 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487227 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487336 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487527 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487617 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487827 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.487914 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.488145 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.488233 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.488450 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.488538 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.488747 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.488833 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489047 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489134 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489344 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489440 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489647 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489733 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.489956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490260 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490356 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490564 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490672 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490890 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.490996 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.491196 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.491285 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.491502 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.491590 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.491805 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.491905 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.492116 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.492213 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.492419 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.492505 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.492725 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.492824 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493029 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493117 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493342 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493431 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493646 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493743 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.493950 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.494037 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.494270 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.494365 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.494581 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.494701 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.494919 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495236 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495325 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495569 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495657 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495870 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.495965 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.496171 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.496267 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.496477 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.496567 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.496786 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.496873 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.497092 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.497180 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.497396 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.497491 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.497699 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.497786 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498007 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498095 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498313 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498403 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498621 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498814 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.498955 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499058 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499265 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499369 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499571 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499671 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499881 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.499983 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.500190 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.500287 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.500492 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.500600 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.500800 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.500908 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.501111 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.501218 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.501493 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.501596 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.502160 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.502275 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.502358 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.502900 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.502997 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503079 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503172 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503254 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503254 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503403 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503490 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503570 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503656 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503743 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503900 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.503994 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.504210 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.504301 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.504536 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.504626 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.504853 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.504940 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.505161 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.505250 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.505461 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.505547 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.505764 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.505873 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.506076 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.506172 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.506385 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.506482 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.506794 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.506896 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.507098 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.507195 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.507400 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.507497 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.507708 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.507795 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508027 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508125 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508328 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508416 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508628 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508716 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.508928 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509025 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509231 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509318 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509534 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509651 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509852 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.509966 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.510261 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.510349 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.510569 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.510718 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.510895 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.510988 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.511198 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.511286 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.511511 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.511637 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.511838 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.511948 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.512146 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.512274 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.512450 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.512593 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.512755 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.512913 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.513078 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.513214 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.513384 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.513549 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.513708 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.513816 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.514127 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.514223 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.514439 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.514535 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.514769 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.514861 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.515084 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.515197 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.515384 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.515474 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.515704 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.515801 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.516023 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.516119 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.516333 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.516429 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.516651 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.516749 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517010 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517096 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517343 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517475 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517659 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517757 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.517986 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.518076 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.518305 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.518392 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.518607 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.518728 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.518934 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.519060 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.519244 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.519372 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.519547 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.519702 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.519848 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.520028 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.520167 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.520345 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.520472 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.520670 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.520779 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521088 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521185 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521392 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521481 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521693 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521781 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.521993 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.522090 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.522316 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.522405 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.522786 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.522886 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.522979 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523068 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523245 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523343 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523549 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523640 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523854 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.523942 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.524152 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.524242 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.524469 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.524560 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.524776 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.524864 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.525076 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.525174 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.525374 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.525475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.525674 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.525772 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526011 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526100 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526312 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526450 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526756 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.526974 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.527075 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.527299 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.527396 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.527606 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.527716 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.527933 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528023 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528255 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528344 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528566 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528656 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528873 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.528959 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.529179 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.529266 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.529478 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.529566 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.529778 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.529866 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.530084 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.530181 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.530383 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.530480 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.530704 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.530808 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531006 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531103 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531312 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531410 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531610 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531706 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.531907 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532009 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532210 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532298 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532526 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532623 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532825 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.532940 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.533656 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.533752 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.533962 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534051 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534261 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534358 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534560 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534664 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534882 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.534970 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.535226 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.535325 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.535533 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.535628 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.535841 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.535936 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.536146 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.536234 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.536450 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.536577 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.536754 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.536850 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537064 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537152 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537368 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537453 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537686 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537867 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.537986 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.538074 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.538292 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.538387 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.538597 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.538733 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.538918 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539002 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539227 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539314 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539535 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539632 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539838 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.539926 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.540145 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.540233 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.540451 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.540553 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.540760 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.540847 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.541083 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.541317 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.541404 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.541640 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.541730 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.541949 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.542037 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.542261 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.542349 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.542570 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.542693 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.542913 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543002 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543224 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543330 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543530 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543628 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543835 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.543930 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.544137 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.544234 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.544444 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.544551 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.544766 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.544857 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.545080 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.545336 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.545426 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.545666 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.545754 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.545983 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.546080 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.546297 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.546386 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.546607 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.546754 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.546942 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547043 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547257 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547343 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547571 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547659 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547878 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.547987 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.548186 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.548276 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.548494 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.548630 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.549395 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.549490 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.549718 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.549807 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.550045 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.550133 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.550383 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.550473 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.550714 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.550803 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551026 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551114 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551336 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551433 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551645 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551742 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.551955 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.552053 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.552304 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.552395 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.552611 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.552699 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.552927 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553024 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553241 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553335 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553553 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553642 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553865 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.553954 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.554181 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.554380 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.554496 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.554714 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.554853 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.555047 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.555169 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.555371 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.555482 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.555693 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.555795 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556008 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556130 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556323 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556412 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556645 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556791 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.556947 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557051 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557249 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557337 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557557 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557647 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557862 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.557950 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.558160 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.558466 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.558565 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.558794 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.558895 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.559097 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.559186 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.559412 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.559510 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.559718 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.559806 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.560070 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.560248 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.560394 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.560593 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.560724 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.560907 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561033 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561230 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561375 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561553 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561642 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561868 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.561956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.562178 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.562279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.562498 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.562587 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.562828 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.562930 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.563135 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.563234 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.563447 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.563536 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.563753 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.563847 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.564059 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.564320 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.564427 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.564678 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.564766 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.564982 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565283 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565371 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565590 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565687 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565889 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.565986 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.566212 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.566302 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.566517 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.566605 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.566845 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.566944 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.567150 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.567237 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.567456 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.567586 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.567758 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.567856 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568058 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568147 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568360 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568448 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568663 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568752 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.568970 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569061 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569272 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569369 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569676 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569880 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.569966 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.570184 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.570270 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.570488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.570577 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.570820 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.570909 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.571127 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.571226 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.571441 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.571529 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.571748 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.571837 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572053 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572150 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572360 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572448 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572666 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572764 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.572975 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.573071 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.573281 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.573371 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.573587 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.573680 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.573928 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.574028 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.574240 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.574328 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.574551 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.574794 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.574904 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.575132 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.575221 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.575449 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.575536 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.575782 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.575889 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.576111 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.576209 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.576418 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.576505 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.576724 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.576831 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.577029 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.577126 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.577604 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.577697 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.577914 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.578017 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.578224 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.578315 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.578531 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.578619 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.578863 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.579153 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.579242 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.579511 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.579604 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.579776 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.579942 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.580104 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.580203 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.580410 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.580497 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.580714 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.580810 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581020 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581107 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581325 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581411 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581634 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581741 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.581947 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.582033 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.582281 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.582368 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.582592 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.582692 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.582930 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583016 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583239 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583323 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583551 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583647 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583856 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.583944 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.584161 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.584247 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.584469 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.584556 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.584776 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.584870 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.585084 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.585182 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.585395 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.585481 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.585705 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.585790 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.586009 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.586110 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.586350 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.586437 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.586688 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.586779 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587014 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587180 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587320 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587468 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587634 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587784 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.587932 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588068 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588249 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588360 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588552 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588646 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588858 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.588947 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.589162 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.589247 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.589488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.589582 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.589806 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.589949 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.590113 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.590252 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.590441 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.590591 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.590757 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.590888 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.591057 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.591213 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.591368 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.591511 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.591725 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.591860 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592003 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592139 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592274 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592419 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592554 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592689 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592824 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.592982 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.593128 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.593295 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.593428 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.593625 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.593763 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.593960 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.594117 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.594256 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.594392 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.594552 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.594729 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.594861 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.595010 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.595162 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.595303 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.595958 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596102 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596263 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596447 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596589 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596726 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596861 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.596997 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.597141 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.597274 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.597432 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.597584 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.597722 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.597858 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598023 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598161 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598325 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598467 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598625 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598734 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.598977 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.599076 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.599311 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.599398 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.599614 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.599732 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.599924 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600030 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600229 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600316 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600534 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600631 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600844 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.600931 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.601154 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.601242 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.601468 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.601565 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.601781 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.601896 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.602088 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.602187 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.602394 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.602504 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.602720 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.602817 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603030 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603117 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603336 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603436 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603645 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603815 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.603955 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604041 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604263 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604351 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604587 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604673 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604909 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.604996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.605214 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.605301 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.605536 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.605630 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.605863 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.605950 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.606180 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.606267 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.606492 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.606577 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.606845 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.606946 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.607157 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.607257 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.607468 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.607562 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.607776 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.607877 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.608087 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.608173 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.608396 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.608557 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.608697 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.608845 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609000 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609140 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609310 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609462 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609630 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609767 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.609952 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.610094 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.610259 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.610356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.610578 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.610707 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.610921 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.611017 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.611794 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.611963 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.612122 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.612210 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.612437 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.612531 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.612751 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.612839 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613071 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613161 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613378 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613465 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613682 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613789 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.613922 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:45:15.614011 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.614299 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.614630 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.614986 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.615300 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.615629 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.615960 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.616311 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.616632 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.616975 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.617314 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.617623 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.617935 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.618243 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:45:15.618487 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:45:15.671342 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO dbcounter [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Registered counter for database nova_api May 25 14:45:15.678469 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Registered counter for database nova_api May 25 14:45:15.692704 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_db.sqlalchemy.engines [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.697805 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.699351 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writer thread running {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.704890 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.756163 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.context [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfbdcb43-9801-4e51-9697-8ab17efd22ad(cell1) {{(pid=115453) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:45:15.760254 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:45:15.761826 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:45:15.762062 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.context [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfbdcb43-9801-4e51-9697-8ab17efd22ad(cell1) {{(pid=115452) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:45:15.762612 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:45:15.764587 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:45:15.766128 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:45:15.766546 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO dbcounter [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Registered counter for database nova_cell0 May 25 14:45:15.767820 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:45:15.768609 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:45:15.770678 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:45:15.770941 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO dbcounter [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Registered counter for database nova_cell1 May 25 14:45:15.772653 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Registered counter for database nova_cell0 May 25 14:45:15.776756 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Registered counter for database nova_cell1 May 25 14:45:15.779165 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_db.sqlalchemy.engines [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.780066 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_db.sqlalchemy.engines [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.786335 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.787484 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.787592 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writer thread running {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.789618 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writer thread running {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.793824 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.795884 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.936945 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO dbcounter [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Registered counter for database nova_cell0 May 25 14:45:15.941664 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Registered counter for database nova_cell0 May 25 14:45:15.945647 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_db.sqlalchemy.engines [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.950146 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writer thread running {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:15.950396 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:45:15.955464 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:45:16.352364 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: WARNING keystonemiddleware.auth_token [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:45:16.359627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: WARNING keystonemiddleware.auth_token [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:45:16.394422 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:45:16.401968 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:45:16.698448 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: WARNING keystonemiddleware.auth_token [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:45:16.704519 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: WARNING keystonemiddleware.auth_token [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:45:16.710282 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623aac149c0 pid: 115453 (default app) May 25 14:45:16.712349 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:45:16.713524 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] 10.222.0.74 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 May 25 14:45:16.713938 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 788 bytes} [Wed May 25 14:45:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:45:16.741288 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:45:16.747212 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-b6096069-b706-45bf-8d4d-0134f436718d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:45:16.752481 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623aac149c0 pid: 115452 (default app) May 25 14:46:38.725197 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:38.726214 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 25 14:46:38.726618 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:38.745522 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_api:SELECT=3 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:38.747624 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_cell0:SELECT=3 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:38.748743 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_cell1:SELECT=3 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:38.750150 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:39.231848 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-7c6abad2-009a-4117-a451-6cad8cecf5d9 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:39.263778 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-7c6abad2-009a-4117-a451-6cad8cecf5d9 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.529948 May 25 14:46:39.264546 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 1/3] 10.222.0.74 () {60 vars in 1291 bytes} [Wed May 25 14:46:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:46:41.563448 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:41.564469 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-290e5e97-8af0-4c60-ab86-7d1dbf36f22c None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 May 25 14:46:41.564868 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 3/4] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:41.626761 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-158fb9b6-a179-4305-9135-9cd779d2751f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:41.645721 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:46:41.645721 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: warnings.warn(msg) May 25 14:46:41.725493 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-158fb9b6-a179-4305-9135-9cd779d2751f admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.154774 May 25 14:46:41.726263 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 2/5] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 14:46:41.940252 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-8de31844-6d24-415b-81d4-905f64912c10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:41.942707 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:46:41.942707 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: warnings.warn(msg) May 25 14:46:41.945425 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_api:SELECT=3 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:41.946237 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_cell1:SELECT=3 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:41.947158 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_cell0:SELECT=3 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:41.947847 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:42.085547 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-8de31844-6d24-415b-81d4-905f64912c10 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.350839 May 25 14:46:42.100964 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 4/6] 10.222.0.74 () {64 vars in 1335 bytes} [Wed May 25 14:46:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:46:44.381615 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-158fb9b6-a179-4305-9135-9cd779d2751f admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:44.382561 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-158fb9b6-a179-4305-9135-9cd779d2751f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 25 14:46:44.383050 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 3/7] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:44.492293 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-0440852c-6285-4788-9cec-7caff19e0e0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "name": "ds512M"}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:44.510143 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:46:44.510143 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: warnings.warn(msg) May 25 14:46:44.613454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-0440852c-6285-4788-9cec-7caff19e0e0f admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.224230 May 25 14:46:44.614003 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 5/8] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:46:44.626181 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-18bccb33-6910-44a7-a36c-a333ac9beacc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:44.627761 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:46:44.627761 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: warnings.warn(msg) May 25 14:46:44.714195 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-18bccb33-6910-44a7-a36c-a333ac9beacc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091819 May 25 14:46:44.715078 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 4/9] 10.222.0.74 () {64 vars in 1335 bytes} [Wed May 25 14:46:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:46:46.980993 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-0440852c-6285-4788-9cec-7caff19e0e0f admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:46.982014 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-0440852c-6285-4788-9cec-7caff19e0e0f admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 25 14:46:46.982409 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:46:47.043160 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33a451e6-3c59-496f-8ac4-369486cded83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:47.131910 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33a451e6-3c59-496f-8ac4-369486cded83 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142511 May 25 14:46:47.132582 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 5/11] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:46:47.145144 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-568af1ac-33b5-46ce-9918-e45d48596446 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:47.238719 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-568af1ac-33b5-46ce-9918-e45d48596446 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097575 May 25 14:46:47.239670 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 7/12] 10.222.0.74 () {64 vars in 1335 bytes} [Wed May 25 14:46:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:46:49.519856 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33a451e6-3c59-496f-8ac4-369486cded83 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:49.520877 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33a451e6-3c59-496f-8ac4-369486cded83 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 25 14:46:49.521281 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 6/13] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:49.585213 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-dd739eda-e615-422b-9bb6-97c10989345d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:49.674504 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-dd739eda-e615-422b-9bb6-97c10989345d admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146432 May 25 14:46:49.675146 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 8/14] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:46:49.686997 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-980c0a17-042f-4d02-9024-9f5c86da1a3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:49.770460 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-980c0a17-042f-4d02-9024-9f5c86da1a3e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087145 May 25 14:46:49.771103 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 7/15] 10.222.0.74 () {64 vars in 1335 bytes} [Wed May 25 14:46:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:46:52.036223 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-dd739eda-e615-422b-9bb6-97c10989345d admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:52.037240 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-dd739eda-e615-422b-9bb6-97c10989345d admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 25 14:46:52.037621 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 9/16] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:52.096963 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-75856ccc-2437-45ae-9c6e-3ee13a682110 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "id": "d4"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:52.178538 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-75856ccc-2437-45ae-9c6e-3ee13a682110 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134602 May 25 14:46:52.179402 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 8/17] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:46:52.191819 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-a43d3a84-b223-4e5c-b101-69c203169f9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:52.273679 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-a43d3a84-b223-4e5c-b101-69c203169f9e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085586 May 25 14:46:52.274402 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 10/18] 10.222.0.74 () {64 vars in 1335 bytes} [Wed May 25 14:46:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:46:54.550093 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-75856ccc-2437-45ae-9c6e-3ee13a682110 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:54.551214 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-75856ccc-2437-45ae-9c6e-3ee13a682110 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 May 25 14:46:54.551609 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 9/19] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:54.614005 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-8ba84fd7-0ace-4925-af23-aa0c1e3aca9a admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:54.637352 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-8ba84fd7-0ace-4925-af23-aa0c1e3aca9a admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079709 May 25 14:46:54.638357 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 11/20] 10.222.0.74 () {60 vars in 1291 bytes} [Wed May 25 14:46:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:46:56.912212 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-75856ccc-2437-45ae-9c6e-3ee13a682110 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:56.913235 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-75856ccc-2437-45ae-9c6e-3ee13a682110 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 25 14:46:56.913634 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 10/21] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:46:56.975449 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-3442592c-9ce5-4645-a54a-f62b5f92ddfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:57.048818 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-3442592c-9ce5-4645-a54a-f62b5f92ddfc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129018 May 25 14:46:57.049552 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 12/22] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:46:57.061866 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-0b8233b2-6c3d-4d69-b03c-046fdb1a4bdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:57.151694 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-0b8233b2-6c3d-4d69-b03c-046fdb1a4bdc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093735 May 25 14:46:57.152208 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 11/23] 10.222.0.74 () {64 vars in 1332 bytes} [Wed May 25 14:46:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:46:59.469967 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-3442592c-9ce5-4645-a54a-f62b5f92ddfc admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:46:59.471024 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-3442592c-9ce5-4645-a54a-f62b5f92ddfc admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 25 14:46:59.471435 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:46:59.543955 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-1acc971e-7860-4b31-b5fe-7c9153299eff admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:59.646857 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-1acc971e-7860-4b31-b5fe-7c9153299eff admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.169112 May 25 14:46:59.647337 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 12/25] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:46:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:46:59.659258 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-02aeeef8-be76-415e-a5d6-f24d0b71b983 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:46:59.735130 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-02aeeef8-be76-415e-a5d6-f24d0b71b983 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079508 May 25 14:46:59.735714 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 14/26] 10.222.0.74 () {64 vars in 1332 bytes} [Wed May 25 14:46:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:02.021310 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-1acc971e-7860-4b31-b5fe-7c9153299eff admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:02.022435 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-1acc971e-7860-4b31-b5fe-7c9153299eff admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 25 14:47:02.023115 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 13/27] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:02.082702 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-df94ad09-17a4-4a53-9f3c-bdb8e46464b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "swap": 0}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:02.212586 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-df94ad09-17a4-4a53-9f3c-bdb8e46464b5 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.183573 May 25 14:47:02.213049 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 15/28] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:47:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 14:47:02.224915 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-bb1bf2ac-c6d9-4aee-a03d-611a01a4336f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:02.307630 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-bb1bf2ac-c6d9-4aee-a03d-611a01a4336f admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086439 May 25 14:47:02.308222 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 14/29] 10.222.0.74 () {64 vars in 1332 bytes} [Wed May 25 14:47:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:47:04.554783 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-df94ad09-17a4-4a53-9f3c-bdb8e46464b5 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:04.555874 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-df94ad09-17a4-4a53-9f3c-bdb8e46464b5 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 25 14:47:04.556394 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 16/30] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:04.620637 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-17b2b558-a4bd-43cd-a4dc-a9b3a42d0410 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:04.708531 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-17b2b558-a4bd-43cd-a4dc-a9b3a42d0410 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.143275 May 25 14:47:04.709085 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 15/31] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:47:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:04.721065 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-ff7facdb-5c26-4574-a475-b6b88820000b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:04.837265 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-ff7facdb-5c26-4574-a475-b6b88820000b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119847 May 25 14:47:04.837947 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 17/32] 10.222.0.74 () {64 vars in 1332 bytes} [Wed May 25 14:47:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:07.118268 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-17b2b558-a4bd-43cd-a4dc-a9b3a42d0410 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:07.119630 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-17b2b558-a4bd-43cd-a4dc-a9b3a42d0410 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001800 May 25 14:47:07.120027 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 16/33] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:07.190384 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-697bfffe-5c03-4b20-ac0b-2cf13eb4db29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "id": "5", "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:08.036430 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-697bfffe-5c03-4b20-ac0b-2cf13eb4db29 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.908618 May 25 14:47:08.037044 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1282 bytes} [Wed May 25 14:47:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:08.049223 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-d4c88053-6c5f-48f3-bc43-52e406629a97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:08.159779 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-d4c88053-6c5f-48f3-bc43-52e406629a97 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114296 May 25 14:47:08.160471 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 17/35] 10.222.0.74 () {64 vars in 1332 bytes} [Wed May 25 14:47:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:47:32.708257 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-697bfffe-5c03-4b20-ac0b-2cf13eb4db29 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:32.709296 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-697bfffe-5c03-4b20-ac0b-2cf13eb4db29 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 25 14:47:32.709688 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 19/36] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:32.716671 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:32.768610 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-b9cea56a-af8b-442d-bf09-0690cb509829 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:32.786759 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-b9cea56a-af8b-442d-bf09-0690cb509829 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070948 May 25 14:47:32.787291 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1291 bytes} [Wed May 25 14:47:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:33.773987 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-697bfffe-5c03-4b20-ac0b-2cf13eb4db29 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:33.775018 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-697bfffe-5c03-4b20-ac0b-2cf13eb4db29 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 25 14:47:33.775443 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 20/38] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:33.975051 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-9deec217-2db6-4c57-8d9a-4ea807b45e78 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:33.980566 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.wsgi [None req-9deec217-2db6-4c57-8d9a-4ea807b45e78 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-9deec217-2db6-4c57-8d9a-4ea807b45e78 admin admin] Request method failure captured: May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Accept: application/json May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Accept-Encoding: gzip, deflate May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Connection: keep-alive May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Content-Length: 0 May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Host: 10.222.0.74 May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Openstack-Api-Version: compute 2.90 May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Openstack-System-Scope: None May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: User-Agent: python-novaclient May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Auth-Token: gAAAAABijkGFoEeCxnjItqfUv0TOyY8pu3IwtvZulQEMgf06xIFYCDaq-xh3GKIoDYtuDH7K-bh9sMMne9FS10cmSOYAohimXl53_8zcdANzMbsQvbDCy4bQAGQtIpwsBuXCjsYBvfEuxyqtxS0cVtN2triBbpLruXSCfdeS2gCAzhmE6AsDvMA May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Domain-Id: None May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Domain-Name: None May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Identity-Status: Confirmed May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Is-Admin-Project: True May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Domain-Id: default May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Domain-Name: Default May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Name: admin May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Role: member,reader,admin May 25 14:47:33.984400 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Roles: member,reader,admin May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}] May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant: admin May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant-Name: admin May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User: admin May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Domain-Id: default May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Domain-Name: Default May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Id: e695952cd3d8473291efec1acc9a5e16 May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Name: admin May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: method: > May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: exception: Flavor 42 could not be found. May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: action_args: {'id': '42'} May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:47:33.986081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:33.987000 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:33.988356 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-9deec217-2db6-4c57-8d9a-4ea807b45e78 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:47:33.989644 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-9deec217-2db6-4c57-8d9a-4ea807b45e78 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062682 May 25 14:47:33.989644 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1190 bytes} [Wed May 25 14:47:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:47:33.995752 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-c9cbf248-9542-4afa-9932-8dfc347adbde admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:33.999208 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:34.017536 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-c9cbf248-9542-4afa-9932-8dfc347adbde admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025353 May 25 14:47:34.018078 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 21/40] 10.222.0.74 () {60 vars in 1210 bytes} [Wed May 25 14:47:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:34.027853 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c102ef39-b850-4391-9dc5-dfe255163e51 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:34.049414 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c102ef39-b850-4391-9dc5-dfe255163e51 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025298 May 25 14:47:34.050892 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 20/41] 10.222.0.74 () {60 vars in 1210 bytes} [Wed May 25 14:47:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:34.061410 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-d25687b5-98c5-4138-b245-67a1bc5028a1 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:34.067105 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.wsgi [None req-d25687b5-98c5-4138-b245-67a1bc5028a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-d25687b5-98c5-4138-b245-67a1bc5028a1 admin admin] Request method failure captured: May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Accept: application/json May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Accept-Encoding: gzip, deflate May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Connection: keep-alive May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Content-Length: 0 May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Host: 10.222.0.74 May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Openstack-Api-Version: compute 2.90 May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Openstack-System-Scope: None May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: User-Agent: python-novaclient May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Auth-Token: gAAAAABijkGFoEeCxnjItqfUv0TOyY8pu3IwtvZulQEMgf06xIFYCDaq-xh3GKIoDYtuDH7K-bh9sMMne9FS10cmSOYAohimXl53_8zcdANzMbsQvbDCy4bQAGQtIpwsBuXCjsYBvfEuxyqtxS0cVtN2triBbpLruXSCfdeS2gCAzhmE6AsDvMA May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Domain-Id: None May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Domain-Name: None May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Identity-Status: Confirmed May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Is-Admin-Project: True May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Domain-Id: default May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Domain-Name: Default May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Name: admin May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Role: member,reader,admin May 25 14:47:34.070308 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Roles: member,reader,admin May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}] May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant: admin May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant-Name: admin May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User: admin May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Domain-Id: default May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Domain-Name: Default May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Id: e695952cd3d8473291efec1acc9a5e16 May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Name: admin May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: method: > May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: exception: Flavor 42 could not be found. May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: action_args: {'id': '42'} May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:47:34.077488 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:34.078627 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:34.080042 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-d25687b5-98c5-4138-b245-67a1bc5028a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:47:34.081270 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-d25687b5-98c5-4138-b245-67a1bc5028a1 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014802 May 25 14:47:34.081270 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 22/42] 10.222.0.74 () {60 vars in 1190 bytes} [Wed May 25 14:47:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:47:34.932749 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c102ef39-b850-4391-9dc5-dfe255163e51 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:34.933741 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c102ef39-b850-4391-9dc5-dfe255163e51 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 25 14:47:34.934130 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 21/43] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:35.124640 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-ea8b98f9-c011-45ca-b72f-efaf252c35b6 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:35.130943 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.wsgi [None req-ea8b98f9-c011-45ca-b72f-efaf252c35b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-ea8b98f9-c011-45ca-b72f-efaf252c35b6 admin admin] Request method failure captured: May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Accept: application/json May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Accept-Encoding: gzip, deflate May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Connection: keep-alive May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Content-Length: 0 May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Host: 10.222.0.74 May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Openstack-Api-Version: compute 2.90 May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Openstack-System-Scope: None May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: User-Agent: python-novaclient May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Auth-Token: gAAAAABijkGGIlPBmStup7wL9qUEmwXmlHTwGs83jrIGRXcRMQmrNz3tNx6RI0sXdlAPcD35aGD2gDAmBhvf_D7y1C1CRWJBYWzeFSTIDg6iUW6ZiN-mZVNf42WcjFLra67SgmffU04eIqg8WaNrnw_m8J1xmFFk2e43o9DiD8zaKRQOKzOaOzI May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Domain-Id: None May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Domain-Name: None May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Identity-Status: Confirmed May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Is-Admin-Project: True May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Domain-Id: default May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Domain-Name: Default May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Name: admin May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Role: member,reader,admin May 25 14:47:35.132578 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Roles: member,reader,admin May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}] May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant: admin May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant-Name: admin May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User: admin May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Domain-Id: default May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Domain-Name: Default May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Id: e695952cd3d8473291efec1acc9a5e16 May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Name: admin May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: method: > May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: exception: Flavor 84 could not be found. May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: action_args: {'id': '84'} May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:47:35.134202 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:35.135235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:35.136731 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-ea8b98f9-c011-45ca-b72f-efaf252c35b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:47:35.138011 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-ea8b98f9-c011-45ca-b72f-efaf252c35b6 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061713 May 25 14:47:35.138011 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 23/44] 10.222.0.74 () {60 vars in 1190 bytes} [Wed May 25 14:47:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:47:35.144671 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-ac222d4f-4b9e-4167-a116-1e85dc644540 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:35.160132 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-ac222d4f-4b9e-4167-a116-1e85dc644540 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019238 May 25 14:47:35.160681 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 22/45] 10.222.0.74 () {60 vars in 1210 bytes} [Wed May 25 14:47:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:35.170120 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-b4a93e53-f3c3-4d8d-949a-5699db0f8d41 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:35.183527 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-b4a93e53-f3c3-4d8d-949a-5699db0f8d41 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016977 May 25 14:47:35.184059 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 24/46] 10.222.0.74 () {60 vars in 1210 bytes} [Wed May 25 14:47:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:47:35.194216 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-4fcea44c-5dfe-4b05-9ee1-8d8f3aa7d6c7 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:35.199625 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.wsgi [None req-4fcea44c-5dfe-4b05-9ee1-8d8f3aa7d6c7 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-4fcea44c-5dfe-4b05-9ee1-8d8f3aa7d6c7 admin admin] Request method failure captured: May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Accept: application/json May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Accept-Encoding: gzip, deflate May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Connection: keep-alive May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Content-Length: 0 May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Host: 10.222.0.74 May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Openstack-Api-Version: compute 2.90 May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Openstack-System-Scope: None May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: User-Agent: python-novaclient May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Auth-Token: gAAAAABijkGGIlPBmStup7wL9qUEmwXmlHTwGs83jrIGRXcRMQmrNz3tNx6RI0sXdlAPcD35aGD2gDAmBhvf_D7y1C1CRWJBYWzeFSTIDg6iUW6ZiN-mZVNf42WcjFLra67SgmffU04eIqg8WaNrnw_m8J1xmFFk2e43o9DiD8zaKRQOKzOaOzI May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Domain-Id: None May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Domain-Name: None May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Identity-Status: Confirmed May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Is-Admin-Project: True May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Domain-Id: default May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Domain-Name: Default May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Name: admin May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Role: member,reader,admin May 25 14:47:35.202006 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Roles: member,reader,admin May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}] May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant: admin May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant-Name: admin May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User: admin May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Domain-Id: default May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Domain-Name: Default May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Id: e695952cd3d8473291efec1acc9a5e16 May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Name: admin May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: method: > May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: exception: Flavor 84 could not be found. May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: action_args: {'id': '84'} May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:47:35.203475 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:35.204279 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:35.205347 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-4fcea44c-5dfe-4b05-9ee1-8d8f3aa7d6c7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:47:35.206349 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-4fcea44c-5dfe-4b05-9ee1-8d8f3aa7d6c7 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012740 May 25 14:47:35.206349 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 23/47] 10.222.0.74 () {60 vars in 1190 bytes} [Wed May 25 14:47:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 14:47:36.062993 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-b4a93e53-f3c3-4d8d-949a-5699db0f8d41 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:36.064008 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-b4a93e53-f3c3-4d8d-949a-5699db0f8d41 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 25 14:47:36.064433 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 25/48] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:36.253424 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-f000ecb7-87d0-4cc7-87c6-10e9cffa3d79 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:36.259161 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.wsgi [None req-f000ecb7-87d0-4cc7-87c6-10e9cffa3d79 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-f000ecb7-87d0-4cc7-87c6-10e9cffa3d79 admin admin] Request method failure captured: May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Accept: application/json May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Accept-Encoding: gzip, deflate May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Connection: keep-alive May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Content-Length: 0 May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Host: 10.222.0.74 May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Openstack-Api-Version: compute 2.90 May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Openstack-System-Scope: None May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: User-Agent: python-novaclient May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Auth-Token: gAAAAABijkGILNIniIMcRS9w60oYkCYv1c6n7_ZtwiIl-gHUosqDNwZLr8UlOiZdJzyaI4VVlT4I6ys4ucLrpWbiKyEj744HhgyI96Za2eZbfULEUFrvdb-b1sc1smoimGY2QC2j7A-7-xiQ4DbA_spdqMnoNTElDR8r1cb2Zj-PeWuR__loqWM May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Domain-Id: None May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Domain-Name: None May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Identity-Status: Confirmed May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Is-Admin-Project: True May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Domain-Id: default May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Domain-Name: Default May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Project-Name: admin May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Role: member,reader,admin May 25 14:47:36.260658 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Roles: member,reader,admin May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}] May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant: admin May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-Tenant-Name: admin May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User: admin May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Domain-Id: default May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Domain-Name: Default May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Id: e695952cd3d8473291efec1acc9a5e16 May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: X-User-Name: admin May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: method: > May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: exception: Flavor 451 could not be found. May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: action_args: {'id': '451'} May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:47:36.261996 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:36.263064 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi May 25 14:47:36.264956 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-f000ecb7-87d0-4cc7-87c6-10e9cffa3d79 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:47:36.266172 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-f000ecb7-87d0-4cc7-87c6-10e9cffa3d79 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059160 May 25 14:47:36.266172 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 24/49] 10.222.0.74 () {60 vars in 1193 bytes} [Wed May 25 14:47:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:47:36.272300 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-faa75dfc-a405-4c49-9251-118f1d0d2621 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:36.288230 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-faa75dfc-a405-4c49-9251-118f1d0d2621 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019470 May 25 14:47:36.288684 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 26/50] 10.222.0.74 () {60 vars in 1210 bytes} [Wed May 25 14:47:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:36.297805 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:36.311156 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016871 May 25 14:47:36.311706 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 25/51] 10.222.0.74 () {60 vars in 1210 bytes} [Wed May 25 14:47:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:47:36.321373 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-2a5aa47d-2aa3-44d5-8b1b-dd20b69f8249 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:36.328167 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.wsgi [None req-2a5aa47d-2aa3-44d5-8b1b-dd20b69f8249 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-2a5aa47d-2aa3-44d5-8b1b-dd20b69f8249 admin admin] Request method failure captured: May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Accept: application/json May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Accept-Encoding: gzip, deflate May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Connection: keep-alive May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Content-Length: 0 May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Host: 10.222.0.74 May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Openstack-Api-Version: compute 2.90 May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Openstack-System-Scope: None May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: User-Agent: python-novaclient May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Auth-Token: gAAAAABijkGILNIniIMcRS9w60oYkCYv1c6n7_ZtwiIl-gHUosqDNwZLr8UlOiZdJzyaI4VVlT4I6ys4ucLrpWbiKyEj744HhgyI96Za2eZbfULEUFrvdb-b1sc1smoimGY2QC2j7A-7-xiQ4DbA_spdqMnoNTElDR8r1cb2Zj-PeWuR__loqWM May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Domain-Id: None May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Domain-Name: None May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Identity-Status: Confirmed May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Is-Admin-Project: True May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Openstack-Nova-Api-Version: 2.90 May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Domain-Id: default May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Domain-Name: Default May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Project-Name: admin May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Role: member,reader,admin May 25 14:47:36.329662 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Roles: member,reader,admin May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/77e7e794d9844bf98e02bc9b4f6dae9f"}]}] May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant: admin May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant-Id: 77e7e794d9844bf98e02bc9b4f6dae9f May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-Tenant-Name: admin May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User: admin May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Domain-Id: default May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Domain-Name: Default May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Id: e695952cd3d8473291efec1acc9a5e16 May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: X-User-Name: admin May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: method: > May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: exception: Flavor 451 could not be found. May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: action_args: {'id': '451'} May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:47:36.331314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:36.332324 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: ERROR nova.api.openstack.wsgi May 25 14:47:36.334157 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-2a5aa47d-2aa3-44d5-8b1b-dd20b69f8249 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:47:36.335441 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-2a5aa47d-2aa3-44d5-8b1b-dd20b69f8249 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013557 May 25 14:47:36.335441 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 27/52] 10.222.0.74 () {60 vars in 1193 bytes} [Wed May 25 14:47:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 14:47:37.198472 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:37.199495 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 25 14:47:37.200138 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:37.387641 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-4aae4b54-fd48-4058-9def-45da11ed6842 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:37.485180 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-4aae4b54-fd48-4058-9def-45da11ed6842 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.148899 May 25 14:47:37.485710 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 28/54] 10.222.0.74 () {64 vars in 1235 bytes} [Wed May 25 14:47:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:38.353610 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:38.354685 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 25 14:47:38.355081 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:38.543612 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-c8f9f4d5-445e-4b2d-9cc9-2a6305fdfc3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:38.615432 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-c8f9f4d5-445e-4b2d-9cc9-2a6305fdfc3b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.123736 May 25 14:47:38.615982 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 29/56] 10.222.0.74 () {64 vars in 1235 bytes} [Wed May 25 14:47:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:39.479349 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:39.480340 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 25 14:47:39.480732 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 28/57] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:39.665226 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-801d03e7-ca17-4c36-b911-4f9a8753e1c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:39.759266 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-801d03e7-ca17-4c36-b911-4f9a8753e1c7 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.143801 May 25 14:47:39.759806 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 30/58] 10.222.0.74 () {64 vars in 1235 bytes} [Wed May 25 14:47:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:40.626046 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:40.627085 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 25 14:47:40.627521 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 29/59] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:40.814439 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-7d3113c2-1811-4d38-beb6-ffbce38f974e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:47:40.908251 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-7d3113c2-1811-4d38-beb6-ffbce38f974e admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.144489 May 25 14:47:40.908846 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 31/60] 10.222.0.74 () {64 vars in 1235 bytes} [Wed May 25 14:47:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:47:41.767970 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:41.768966 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 25 14:47:41.769363 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 30/61] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:47:41.956196 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-5c907d55-d0a2-4255-9388-5fe0fb06e1fd admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:47:41.974886 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-5c907d55-d0a2-4255-9388-5fe0fb06e1fd admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069925 May 25 14:47:41.975408 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 32/62] 10.222.0.74 () {60 vars in 1202 bytes} [Wed May 25 14:47:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:43.756258 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.758091 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-33748dc6-95c9-40b8-ae4b-aabac857e2f1 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002458 May 25 14:48:43.758904 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 930 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:48:43.766391 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:43.819938 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-f92dbd74-fc72-4dd6-8f03-954f76c90f2f admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.838836 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-f92dbd74-fc72-4dd6-8f03-954f76c90f2f admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073936 May 25 14:48:43.839371 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 33/64] 10.222.0.74 () {60 vars in 1291 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:48:43.860471 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_api:SELECT=14 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:43.864146 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-7cdd13f4-a7f5-4fc3-b571-e82ceb106d9f admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.871586 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-7cdd13f4-a7f5-4fc3-b571-e82ceb106d9f admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012692 May 25 14:48:43.873532 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 32/65] 10.222.0.74 () {60 vars in 1282 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:48:43.884040 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-536f4a76-6b32-4b3c-88fc-e59f346094f9 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.891760 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-536f4a76-6b32-4b3c-88fc-e59f346094f9 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011298 May 25 14:48:43.892282 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 34/66] 10.222.0.74 () {60 vars in 1285 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:48:43.903648 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.911916 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012070 May 25 14:48:43.912432 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 33/67] 10.222.0.74 () {60 vars in 1285 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:48:43.925613 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-b151b083-79a9-438b-a500-d67ce216b5ec admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:48:43.933182 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-b151b083-79a9-438b-a500-d67ce216b5ec admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011155 May 25 14:48:43.933695 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 35/68] 10.222.0.74 () {60 vars in 1282 bytes} [Wed May 25 14:48:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:52:28.668038 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:28.669042 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 25 14:52:28.669435 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 34/69] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:52:28.827078 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_api:SELECT=6 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:28.947584 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-1cccfdf0-8f44-4e04-8fe5-8129c6942649 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:28.950454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:52:28.950454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: warnings.warn(msg) May 25 14:52:28.950454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-1cccfdf0-8f44-4e04-8fe5-8129c6942649 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:28.950454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-1cccfdf0-8f44-4e04-8fe5-8129c6942649 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:28.951314 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-1cccfdf0-8f44-4e04-8fe5-8129c6942649 admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:28.951749 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-1cccfdf0-8f44-4e04-8fe5-8129c6942649 admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:28.985964 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-1cccfdf0-8f44-4e04-8fe5-8129c6942649 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159750 May 25 14:52:28.986528 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 36/70] 10.222.0.74 () {60 vars in 1193 bytes} [Wed May 25 14:52:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:52:29.863320 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:29.864330 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 25 14:52:29.864729 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 35/71] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:52:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:52:30.061658 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-dca2fb83-b83c-47ab-858c-69d52fbe92e4 admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:30.062876 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:52:30.062876 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: warnings.warn(msg) May 25 14:52:30.064068 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-dca2fb83-b83c-47ab-858c-69d52fbe92e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:30.064530 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-dca2fb83-b83c-47ab-858c-69d52fbe92e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:30.065332 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-dca2fb83-b83c-47ab-858c-69d52fbe92e4 admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:30.065754 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-dca2fb83-b83c-47ab-858c-69d52fbe92e4 admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:30.085246 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-dca2fb83-b83c-47ab-858c-69d52fbe92e4 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076526 May 25 14:52:30.085793 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 37/72] 10.222.0.74 () {60 vars in 1193 bytes} [Wed May 25 14:52:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:52:41.388039 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:41.389617 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 May 25 14:52:41.394736 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 36/73] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:52:41.537132 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_cell0:SELECT=4 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:41.537829 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_cell1:SELECT=4 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:41.538672 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG dbcounter [-] [115453] Writing DB stats nova_api:SELECT=8 {{(pid=115453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:41.593811 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-84bcce28-0c28-4c4d-8d1a-414272024bbf admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:41.595040 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:52:41.595040 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: warnings.warn(msg) May 25 14:52:41.596247 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-84bcce28-0c28-4c4d-8d1a-414272024bbf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:41.596686 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-84bcce28-0c28-4c4d-8d1a-414272024bbf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:41.597454 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-84bcce28-0c28-4c4d-8d1a-414272024bbf admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:41.597885 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-84bcce28-0c28-4c4d-8d1a-414272024bbf admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:41.661813 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-84bcce28-0c28-4c4d-8d1a-414272024bbf admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.129004 May 25 14:52:41.662395 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 38/74] 10.222.0.74 () {60 vars in 1193 bytes} [Wed May 25 14:52:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:52:42.554573 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:42.555610 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c5f906c9-d72e-41ad-bc7a-566f7b76e0b4 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 25 14:52:42.556078 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 37/75] 10.222.0.74 () {56 vars in 1074 bytes} [Wed May 25 14:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:52:42.746235 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG nova.api.openstack.wsgi [None req-82ca1f8f-e9c6-4000-adbc-07c87a8790cf admin admin] Calling method '>' {{(pid=115453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:52:42.747428 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:52:42.747428 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: warnings.warn(msg) May 25 14:52:42.748633 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-82ca1f8f-e9c6-4000-adbc-07c87a8790cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:42.749073 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-82ca1f8f-e9c6-4000-adbc-07c87a8790cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:42.749843 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-82ca1f8f-e9c6-4000-adbc-07c87a8790cf admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:52:42.750262 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: DEBUG oslo_concurrency.lockutils [None req-82ca1f8f-e9c6-4000-adbc-07c87a8790cf admin admin] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:52:42.772746 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: INFO nova.api.openstack.requestlog [None req-82ca1f8f-e9c6-4000-adbc-07c87a8790cf admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077687 May 25 14:52:42.773300 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: [pid: 115453|app: 0|req: 39/76] 10.222.0.74 () {60 vars in 1193 bytes} [Wed May 25 14:52:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:53:44.108554 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: Wed May 25 14:53:44 2022 - graceful shutdown triggered... May 25 14:53:44.108609 dv-cinder-830283-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 14:53:44.109678 dv-cinder-830283-3-iscsi devstack@n-api.service[115452]: Gracefully killing worker 1 (pid: 115452)... May 25 14:53:44.110080 dv-cinder-830283-3-iscsi devstack@n-api.service[115453]: Gracefully killing worker 2 (pid: 115453)... May 25 14:53:45.110762 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: worker 1 buried after 1 seconds May 25 14:53:45.110762 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: worker 2 buried after 1 seconds May 25 14:53:45.110762 dv-cinder-830283-3-iscsi devstack@n-api.service[115451]: goodbye to uWSGI. May 25 14:53:45.112936 dv-cinder-830283-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 14:53:45.113502 dv-cinder-830283-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 14:53:45.116306 dv-cinder-830283-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 14:53:45.140655 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:53:45 2022] *** May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: nodename: dv-cinder-830283-3-iscsi May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: machine: x86_64 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: clock source: unix May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: pcre jit disabled May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: detected number of CPU cores: 4 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: current working directory: / May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: detected binary path: /usr/bin/uwsgi-core May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: your processes number limit is 47680 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: your memory page size is 4096 bytes May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: detected max file descriptor number: 2048 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: lock engine: pthread robust mutexes May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: thunder lock: enabled May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 14:53:45.158227 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:53:45.208858 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: Python main interpreter initialized at 0x5616b2d459c0 May 25 14:53:45.208858 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: python threads support enabled May 25 14:53:45.208858 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: your server socket listen backlog is limited to 100 connections May 25 14:53:45.208858 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: your mercy for graceful operations on workers is 90 seconds May 25 14:53:45.209293 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:53:45.209293 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: *** Operational MODE: preforking *** May 25 14:53:45.209539 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: *** uWSGI is running in multiple interpreter mode *** May 25 14:53:45.209539 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: spawned uWSGI master process (pid: 129892) May 25 14:53:45.209744 dv-cinder-830283-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 14:53:45.210356 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: spawned uWSGI worker 1 (pid: 129907, cores: 1) May 25 14:53:45.210855 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: spawned uWSGI worker 2 (pid: 129908, cores: 1) May 25 14:53:45.211181 dv-cinder-830283-3-iscsi devstack@n-api.service[129892]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:53:46.397359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:53:46.400201 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 14:53:47.191803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:53:47.191803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: from cryptography.utils import int_from_bytes May 25 14:53:47.192285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:53:47.192285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: from cryptography.utils import int_from_bytes May 25 14:53:47.204928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:53:47.204928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: from cryptography.utils import int_from_bytes May 25 14:53:47.205268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:53:47.205268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: from cryptography.utils import int_from_bytes May 25 14:53:49.649015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:53:49.649564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:53:49.649849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:53:49.650081 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:53:49.650342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:53:49.650763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.651094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.651422 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.651751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.652086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.652401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.652724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.653050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.653379 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.653643 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.653964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.654292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-3-iscsi {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.654620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.654956 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.655273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.655595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.655907 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.656233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.656544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.657043 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.658526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.658526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.658526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.658526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.659610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.659610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.659919 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.660242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.660566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.660878 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.661292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-3-iscsi {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.661615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.661929 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.662243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.662677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.663004 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.663325 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.663642 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.663971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.664286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.664616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.664941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.665262 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.665586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.665896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.666214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.666531 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.666876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.667193 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.667526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.667763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.668078 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.668402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.668727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.669053 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.669313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.669570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.669895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.670221 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.670536 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.670871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.671188 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.671502 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.671892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.672161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.672444 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.672758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.673079 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.673399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.673727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.674041 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.674394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.674825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.675082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.675396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.675740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.676064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.676381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.676706 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.677031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.677345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.677659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.677972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.678292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.678621 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.678956 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.679212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.679519 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.679833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.680156 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.680467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.680781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.681091 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.681397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.681712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.682019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.682330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.682678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.682971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.683281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.683592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.683901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.684210 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.684530 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.684855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.685153 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:53:49.685654 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.685815 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:53:49.685961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.685961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.686247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:53:49.686401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.686547 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:53:49.686730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.686894 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:53:49.687059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.687206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.687376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.687535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.687712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.687889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688044 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688197 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688652 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.688963 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689272 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.689879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.690167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.690314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.690514 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.690712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-3-iscsi {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.690881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.691025 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.691177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.691331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.691515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.692122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.692302 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.692460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.692631 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.692790 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.693270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.693270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.693564 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.693708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.693853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.694004 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.694164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.694337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.694502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.694669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.694821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.695090 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.695351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.695504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.695658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.695811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.695966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.696129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.696275 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.696419 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.696582 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.696744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.696980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.697134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.697288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.697441 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.697587 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.697743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.697900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-3-iscsi {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.698054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.698200 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.698344 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.698497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.698683 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.698835 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.698981 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.699126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.699282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.699428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.699589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.699747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.699899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.700053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.700198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.700353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.700509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.700655 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.700807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.700952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.701096 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.701250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.701396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.701396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.701680 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.702278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.702433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.702589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.702769 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.702927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.703073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.703073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.703462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.703462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.703759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.703913 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.704068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.704068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.704359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.704515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.704660 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.704804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.704964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.705219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.705397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.706143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.706305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.706453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.706612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.706816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.706983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.707139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.707286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.707449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.707604 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.707769 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.707923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.708076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.708222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.708373 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.708526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.708681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.708842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.708995 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.709164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.709923 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.710092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.710251 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.710404 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.710550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.710769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.710930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.711086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.711240 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.711393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.711546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.711699 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.711852 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.712522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.712692 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.712838 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.713058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.713206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.713206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.713614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.713614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.713905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.714067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.714212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.714212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.714510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.714690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.714842 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.714987 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.715144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.715425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.715587 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.715741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.715893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.716037 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.716308 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.716475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.716630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.716777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.716940 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.717085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.717236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.717392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.717538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.717682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.717826 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.717970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.718123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.718289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.718435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.718587 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.718809 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.718968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.719129 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.719276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.719420 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.719564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.719720 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.719876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.720030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.720175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.720319 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.720464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.720609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.720753 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.720922 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.721138 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.721914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.722060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.722672 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.722994 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.723146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.723306 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.723460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.723630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.723845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.723996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.724161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.724317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.724464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.724607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.724751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.724895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.725048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.725207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.725352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.725600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.725760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.725914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.726069 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.726233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.726483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.726673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.726919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.727069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.727214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.727357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.727501 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.727663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.727808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.727952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.728108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.728260 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.728419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.728581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.728727 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.728871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.729016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.729170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.729323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.729482 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.729637 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.729799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.729945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.730097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.730244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.730407 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.730553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.730724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.730884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.731029 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.731183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.731329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.731474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.731617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.731761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.731905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.732059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.732212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.732816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.733035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.733187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.733187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.733485 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.733642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.733795 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.734041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.734193 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.734337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.734497 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.734683 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.734847 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.734993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.735148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.735312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.736555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.736825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:53:49.736983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.737140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.737297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.737445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.737607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.737760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.737918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.738064 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.738220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.738366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.738521 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.738709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.738863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.739024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.739189 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.739343 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.739520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.739779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.740017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.740283 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.740517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.741478 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.741637 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.741794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.741949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.742106 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.742297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.742477 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.743226 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.743393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.743540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.743709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.743910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.744082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.744317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.744469 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.744623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.744780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.744926 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.745071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.748680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.749088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.749552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.749704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.749861 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750399 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750922 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.750922 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.751241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.751387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.751532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.751677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.751836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.751989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.752135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.752282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.752462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.752618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.752773 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.753382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.753559 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.753715 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.753862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.754015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.754182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.754348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.754571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.754743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.754901 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755364 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755824 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.755985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.756139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.756291 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.756446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.756593 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.756739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.756894 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757195 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757340 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757651 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.757959 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.758105 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.758258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.758412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.758578 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.758935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.759094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.759249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.759404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.759558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.759723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.759883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760182 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.760972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.761127 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.761272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.761416 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.761575 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.761767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.761923 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.762069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.762221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.762367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.762521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.762699 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.762894 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.763482 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.763643 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.763643 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.764022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.764022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.764314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.764314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.764691 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.764857 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765004 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765302 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765601 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.765915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.766062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.766207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.766207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.766502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.766692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.766857 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.767922 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.768599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.768766 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769106 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769217 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769754 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.769941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770122 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770370 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770684 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.770973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771069 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771237 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771650 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.771979 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772064 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772160 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772246 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.772931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.773024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.773117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.773216 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.773737 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.773841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.773928 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774025 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774118 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774562 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774851 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.774944 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775395 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775488 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.775991 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776704 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.776993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777665 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.777758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778138 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.778617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779302 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.779981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780218 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780644 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.780781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781195 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.781750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.782056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.782294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.782402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.782599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.782908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.783017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.783241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.783517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.784569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.784683 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.784779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.784865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.785123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.785215 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.785469 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.785708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.785824 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.786078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.786299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.786401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.786732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.786902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.787046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.787363 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.787453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.787675 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.787978 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.788074 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.788302 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.788549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.788647 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.788912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.789125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.789219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.789522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.789700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.789831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.790141 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.790266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.790462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.790801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.790897 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.791116 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.791382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.791476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.791721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.791970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.792075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.792335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.792545 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.792927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.793021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.793264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.793557 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.793669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.793890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.794084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.794208 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.794589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.794743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.794883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.795186 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.795280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.795554 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.795765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.795937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.796164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.796367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.796602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.796763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.797002 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.797096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.797370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.797570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.797664 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.797969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.798136 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.798284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.798590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.798727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.798923 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.799247 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.799353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.799636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.799826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.799930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.800193 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.800406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.800501 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.800798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.801006 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.801121 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.801432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.801707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.801815 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.802081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.802301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.802403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.802741 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.803002 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.803109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.803371 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.803683 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.803794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.804036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.804212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.804342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.804653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.804759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.804965 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.805783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.805909 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.805998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.806094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.806453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.806453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.806660 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.806765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.806876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.807173 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.807275 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.807528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.807790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.807883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.808138 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.808365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.808458 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.808747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.808967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.809067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.809355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.809547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.809653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.809959 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.810126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.810261 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.810571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.810714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.810908 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.811206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.811301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.811514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.811820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.811912 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.812136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.812389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.812490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.812726 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.813004 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.813099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.813323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.813576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.813677 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.813922 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.814181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.814295 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.814537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.814871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.814984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.815230 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.815391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.815539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.815844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.815937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.816148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.816495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.816610 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.816770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.817033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.817140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.817374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.818418 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.818522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.818609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.818736 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.818736 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.818915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.819086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.819188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.819452 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.819669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.819772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.820325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.820431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.820519 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.820684 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.820842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.821078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.821393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.821494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.821700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.821988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.822090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.822301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.822681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.822970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.823323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.823499 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.823631 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.823998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.824146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.824253 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.824563 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.824681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.825018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.825154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.825249 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.825477 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.825735 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.825830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.826092 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.826311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.826405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.826722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.826913 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.827021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.827334 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.827506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.827646 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.827957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.828049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.828282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.828560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.828662 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.828913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.829144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.829237 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.829510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.829721 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.829830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.830118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.830443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.831096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.831301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.831395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.831721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.831893 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.831996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.832213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.833617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.833740 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.833830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.833924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834129 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834129 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.834944 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835379 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835465 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835739 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.835909 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836776 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.836899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837145 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837753 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.837972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.838075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.838284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.838386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.838602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.838742 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.838949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.839067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.839256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.839385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.839672 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.839773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.839986 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.840081 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.840290 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.840384 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.840598 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.840869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.840974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841293 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.841898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.842113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.842212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.842417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.842746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.842960 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.843067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.843299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.843401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.843665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.843770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.844031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.844124 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.844343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.844437 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.844716 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.844842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845065 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845771 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.845996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.846126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.847493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.847609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.847713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.847800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.847894 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848449 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848541 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.848811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849127 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.849974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.850069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.850396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.850512 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.850823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.850960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.851253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.851617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.851937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.852116 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.852289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.852453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.852608 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.852866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853032 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853360 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.853973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.854116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.854363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.854926 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855199 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855332 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855912 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.855912 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.856132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.856257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.856349 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.856609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.856699 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857002 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857429 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.857899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.858026 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.858219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.858327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.858539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.858670 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.858898 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859213 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859521 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.859917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.860131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.860233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.860474 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.860567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.860780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.860885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.861102 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.861208 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.861429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.861520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.861814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862200 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862382 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.862872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.863078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.863171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.863411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.863510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.863740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.863839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.864049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.864150 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.864357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.864449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.864672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.864771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865173 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865377 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.865993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.866095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.866300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.866394 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.866606 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.866895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867551 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.867931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.868884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.869089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.869192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.869431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.869526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.869736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.869838 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.870070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.870178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.870389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.870492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.870724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.870825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.871041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.871149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.871355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.871450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.871693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.871803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872131 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872734 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.872971 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.873059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.873297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.873386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.873616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.873716 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.873935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.874035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.874246 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.874355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.874567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.874749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.874924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.875034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.875246 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.875363 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.875573 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.875942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876438 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876754 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.876849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.877068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.877170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.877427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.877535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.877747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.878023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.878127 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.878358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.878459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.878685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.878797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879100 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879737 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.879961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.880063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.880279 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.880374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.880597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.880692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.880911 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881634 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.881969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.882209 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.882325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.882517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.882611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.882858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.882954 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.883176 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.883271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.883496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.883622 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.883811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.883922 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.884121 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.884231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.884436 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.884546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.884751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.884851 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.885064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.885166 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.885382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.885484 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.885699 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.885809 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886012 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886432 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886664 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.886992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.887147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.887296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.887442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.887608 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.887757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.887926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.888075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.888248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.888441 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.888591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.888759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.888903 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.889094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.889230 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.889420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.889566 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.889743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.889885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.890060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.890209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.890376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.890658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.890767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.890990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.891083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.891311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.891409 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.891621 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.891714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.891931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.892024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.892237 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.892358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.892555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.892648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.892864 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.893525 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.893719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.893847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.894038 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.894140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.894345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.894436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.894677 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.894904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.895001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.895262 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.895405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.895615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.895718 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.895928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.896024 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.896255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.896407 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.896570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.896836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.897109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.897255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.897463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.897600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.897775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.897924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.898069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.898209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.898417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.898518 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.898784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.898907 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.899122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.899272 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.899409 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.899696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.899812 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900019 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900119 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900643 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.900951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901042 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.901976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.902192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.902306 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.902510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.902630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.902840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.902961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.903177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.903311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.903488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.903697 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.903801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.904097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.904203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.904410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.904516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.904722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.904901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.905027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.905218 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.905338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.905599 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.905722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.905958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.906057 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.906272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.906400 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.906583 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.906750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.906917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.907061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.907235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.907336 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.907549 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.907674 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.907933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.908037 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.908220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.908451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.908549 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.909421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.909628 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.909868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910624 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.910990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.911091 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.911288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.911462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.911904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.912132 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.912234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.912676 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.912777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.913016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.913135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.913345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.913456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.913685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.913778 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914024 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914131 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914437 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.914979 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.915070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.915309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.915413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.915623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.915709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.915937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916038 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916251 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916666 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916875 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.916979 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.917186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.917285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.917491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.917590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.917803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.917907 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.918117 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.918215 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.918426 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.918524 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.918758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.918939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.919071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.919164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.919382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.919474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.919696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.919798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920036 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920138 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920360 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920458 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.920997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.921095 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.921314 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.921411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.921628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.921733 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.921934 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922246 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922557 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922702 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.922982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.923238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.923374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.923550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.923667 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.923855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.923968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.924319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.924416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.924637 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.924732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.924955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.925048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.925274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.925383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.925587 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.925695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.925912 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926334 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926884 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.926973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.927200 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.927318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.927529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.927624 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.927866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.927969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.928214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.928315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.928520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.928614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.928828 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.928911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.929134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.929217 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.929439 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.929529 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.929751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.929831 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.930068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.930150 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.930381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.930469 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.930784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.930894 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931321 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931626 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.931931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932234 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932329 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932643 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.932943 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.933151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.933243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.933495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.933604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.933760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.933861 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.934065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.934164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.934375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.934503 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.934705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.934836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935169 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.935966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.936079 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.936272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.936367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.936579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.936692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.936918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.937038 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.937258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.937364 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.937582 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.937745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.937893 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938514 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938687 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.938960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.939167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.939343 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.939498 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.939593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.939790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.939936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.940126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.940226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.940459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.940551 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.940770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.940871 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.941081 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.941181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.941394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.941486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.941705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.941798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.942015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.942108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.942328 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.942424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.942684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.942779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.943252 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.943345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.943561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.943672 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.943887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.943997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.944209 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.944314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.944531 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.944638 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.944850 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.944942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.945165 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.945264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.945500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.945692 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.945810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.945904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.946116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.946221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.946430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.946534 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.946764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.946862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.947085 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.947185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.947401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.947505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.947717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.947819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.948049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.948140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.948367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.948506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.948687 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.948871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.949019 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.949280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.949401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.949616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.949709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.949997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.950097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.950350 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.950462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.950810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.950925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.951132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.951225 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.951451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.951555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.951764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.951864 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.952013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:53:49.952114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:53:49.952315 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:53:50.012450 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO dbcounter [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Registered counter for database nova_api May 25 14:53:50.012773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO dbcounter [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Registered counter for database nova_api May 25 14:53:50.033022 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.035197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_db.sqlalchemy.engines [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.041601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writer thread running {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.043116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writer thread running {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.100135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.context [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfbdcb43-9801-4e51-9697-8ab17efd22ad(cell1) {{(pid=129908) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:53:50.101764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.context [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfbdcb43-9801-4e51-9697-8ab17efd22ad(cell1) {{(pid=129907) load_cells /opt/stack/nova/nova/context.py:464}} May 25 14:53:50.104319 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:50.105884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:50.106049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:50.106730 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:50.107557 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:50.108377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:53:50.108778 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:50.110421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:53:50.110832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO dbcounter [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Registered counter for database nova_cell0 May 25 14:53:50.113048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO dbcounter [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Registered counter for database nova_cell0 May 25 14:53:50.116035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO dbcounter [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Registered counter for database nova_cell1 May 25 14:53:50.117114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO dbcounter [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Registered counter for database nova_cell1 May 25 14:53:50.123415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.125242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.128149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_db.sqlalchemy.engines [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.129368 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_db.sqlalchemy.engines [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.132173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writer thread running {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.133454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writer thread running {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.136095 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writer thread running {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.137381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writer thread running {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.286365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO dbcounter [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Registered counter for database nova_cell0 May 25 14:53:50.287208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO dbcounter [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Registered counter for database nova_cell0 May 25 14:53:50.293893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.295568 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_db.sqlalchemy.engines [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:53:50.298820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writer thread running {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.300414 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writer thread running {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:53:50.625517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: WARNING keystonemiddleware.auth_token [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:53:50.626749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: WARNING keystonemiddleware.auth_token [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:53:50.633166 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: WARNING keystonemiddleware.auth_token [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:53:50.634236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: WARNING keystonemiddleware.auth_token [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:53:50.978534 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: WARNING keystonemiddleware.auth_token [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:53:50.984611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: WARNING keystonemiddleware.auth_token [None req-a0a35308-f81e-46e1-a757-f90aab097520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:53:50.989543 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: WARNING keystonemiddleware.auth_token [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 14:53:50.990446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5616b2d459c0 pid: 129908 (default app) May 25 14:53:50.996096 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: WARNING keystonemiddleware.auth_token [None req-d3db49ef-6f64-49c0-928b-1e5064758fd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 14:53:51.001339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5616b2d459c0 pid: 129907 (default app) May 25 14:54:33.518997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=3 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:33.518997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=3 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:33.518997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=3 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:33.518997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=3 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:34.330808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a4cf6f9b-f68a-4f2d-b750-3d86b54936f0 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Action: 'create', calling method: .version_select at 0x7f6fb66d3dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-819812829", "metadata": {"Type": "work"}}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:36.146024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a4cf6f9b-f68a-4f2d-b750-3d86b54936f0 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.642573 May 25 14:54:36.147193 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 1/1] 10.222.0.74 () {60 vars in 1155 bytes} [Wed May 25 14:54:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2645 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 14:54:36.609496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d308347c-0854-4838-b8e7-6322edf623d5 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Calling method '.version_select at 0x7f6fb67925e0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:36.635831 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:36.636054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:36.637465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:36.639071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:36.974870 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1983332699", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "networks": [{"uuid": "5a350648-3aa0-418a-a25c-ca2375ff07bb"}]}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:37.124967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.network.neutron [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] validate_networks() for [('5a350648-3aa0-418a-a25c-ca2375ff07bb', None, None, None, None, None)] {{(pid=129908) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:54:37.284767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d308347c-0854-4838-b8e7-6322edf623d5 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c" status: 200 len: 352 microversion: 2.1 time: 1.128586 May 25 14:54:37.285856 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 1/2] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:54:36 2022] GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c => generated 352 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:38.299642 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3c13891b-cb78-4baa-ba63-dd2199d99a66 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Calling method '.version_select at 0x7f6fb65dbdc0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:38.307966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Flavor limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:54:38.310966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Image limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:54:38.312174 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Flavor pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:54:38.312800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Image pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:54:38.313426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:54:38.338946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:38.339669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:38.340559 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:38.340999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:38.386289 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Getting quotas for project 4a1a1173d9a24de2b797fdf1c72f4131. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:54:38.395474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Getting quotas for user 8a96ba1833514a7ba5f17409d0781026 and project 4a1a1173d9a24de2b797fdf1c72f4131. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:54:38.402540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3c13891b-cb78-4baa-ba63-dd2199d99a66 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c" status: 200 len: 353 microversion: 2.1 time: 0.107876 May 25 14:54:38.404018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:54:38 2022] GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:54:38.410609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Going to run 1 instances... {{(pid=129908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:54:38.413930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:54:38.420038 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-513711ff-58d3-47b2-b781-3bde0aae45c5 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Calling method '.version_select at 0x7f6fb659e310>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:38.508204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-513711ff-58d3-47b2-b781-3bde0aae45c5 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c" status: 200 len: 353 microversion: 2.1 time: 0.094001 May 25 14:54:38.511497 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 3/4] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:54:38 2022] GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:38.524815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7743d973-7bf0-4fc2-9615-a1cd0aca1f73 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Calling method '.version_select at 0x7f6fb659e9d0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:38.588374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b7a60790-5e89-41ae-b047-316212b5bb8b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696249 May 25 14:54:38.589267 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 2/5] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 14:54:38.606585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b61f7105-9045-4e4e-a857-3712ab0e1d9e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:38.609726 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b61f7105-9045-4e4e-a857-3712ab0e1d9e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:38.763929 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b61f7105-9045-4e4e-a857-3712ab0e1d9e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:38.783426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b61f7105-9045-4e4e-a857-3712ab0e1d9e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1215 microversion: 2.1 time: 0.186589 May 25 14:54:38.803712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 3/6] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:38 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:38.879964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7743d973-7bf0-4fc2-9615-a1cd0aca1f73 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c" status: 202 len: 0 microversion: 2.1 time: 0.358968 May 25 14:54:38.880526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 4/7] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 14:54:38 2022] DELETE /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 14:54:38.901486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e4f2158e-6f26-46a5-b15a-0483146dba78 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Calling method '.version_select at 0x7f6fb545ba60>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:38.995123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e4f2158e-6f26-46a5-b15a-0483146dba78 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c" status: 200 len: 352 microversion: 2.1 time: 0.107614 May 25 14:54:39.000118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 4/8] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:54:38 2022] GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:39.806383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0b53bc3f-ebbd-4be8-a5cf-0e320fb87272 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:39.806383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0b53bc3f-ebbd-4be8-a5cf-0e320fb87272 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:39.991788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0b53bc3f-ebbd-4be8-a5cf-0e320fb87272 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:40.016189 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-086cc2be-5b2c-4e30-8dfd-cab9f8352926 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Calling method '.version_select at 0x7f6fb546bdc0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:40.019509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0b53bc3f-ebbd-4be8-a5cf-0e320fb87272 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1215 microversion: 2.1 time: 0.221917 May 25 14:54:40.022242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 5/9] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:39 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:40.101346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-086cc2be-5b2c-4e30-8dfd-cab9f8352926 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] HTTP exception thrown: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-086cc2be-5b2c-4e30-8dfd-cab9f8352926 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Request method failure captured: May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c HTTP/1.1 May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkMpwqjFU0pUqrkjbBOVxp6Kk9Vl-jjpWR67Zoqw_PfWrLQCI5_HYGoNvhvz-FSZVcReQJ6ur7DZz9AqlpHAZVr44qTzBUul-gps1iUbjdQsZobPOjCX-3VLoPmRn_Z06o5wEqq05m4AuXzKKPeUgfIvtiNgRPVORyqBkDAnywuXGHw May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 23ff6c12f7604fe589925cd62611ccc3 May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesGetTestJSON-941950957 May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:54:40.107052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_23ff6c12f7604fe589925cd62611ccc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/23ff6c12f7604fe589925cd62611ccc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/23ff6c12f7604fe589925cd62611ccc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/23ff6c12f7604fe589925cd62611ccc3"}]}] May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesGetTestJSON-941950957 May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 23ff6c12f7604fe589925cd62611ccc3 May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesGetTestJSON-941950957 May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesGetTestJSON-941950957-project May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 2e20671c2bde4268b88a66924290017a May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesGetTestJSON-941950957-project May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'dd65c258-769b-4b3a-be6d-afe3576c1f2c'} May 25 14:54:40.108048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. (HTTP 404) (Request-ID: req-4b4b40a8-b8c0-4ad7-aa8a-81fe515afab3) May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:54:40.108641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:54:40.109474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:54:40.111218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-086cc2be-5b2c-4e30-8dfd-cab9f8352926 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] Returning 404 to user: Volume dd65c258-769b-4b3a-be6d-afe3576c1f2c could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:54:40.112075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-086cc2be-5b2c-4e30-8dfd-cab9f8352926 tempest-VolumesGetTestJSON-941950957 tempest-VolumesGetTestJSON-941950957-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c" status: 404 len: 109 microversion: 2.1 time: 0.105683 May 25 14:54:40.113440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 5/10] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:54:40 2022] GET /compute/v2.1/os-volumes/dd65c258-769b-4b3a-be6d-afe3576c1f2c => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:54:41.043542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6fa4b0a9-9498-4e9e-8e61-ef11de8ce5e3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:41.044238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6fa4b0a9-9498-4e9e-8e61-ef11de8ce5e3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:41.181515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6fa4b0a9-9498-4e9e-8e61-ef11de8ce5e3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:41.199656 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6fa4b0a9-9498-4e9e-8e61-ef11de8ce5e3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1215 microversion: 2.1 time: 0.160212 May 25 14:54:41.204193 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 6/11] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:41 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:42.221228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:42.222511 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:42.231845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:42.234239 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:42.235799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:42.245195 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:42.503357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:42.527689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0242e937-5437-43e6-a9c1-bbf8cb89559f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1219 microversion: 2.1 time: 0.310597 May 25 14:54:42.528280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 6/12] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:42 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1219 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:43.554332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:43.555556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:43.577592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:43.578043 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:43.578895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:43.579363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:43.991823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:44.038719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cba8f1bd-6bff-4135-b8f8-52e07e7bacf7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1219 microversion: 2.1 time: 0.497161 May 25 14:54:44.044539 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 7/13] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:43 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1219 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:44.941599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c0d3189e-65a2-40bd-ac23-f12cfdd302c2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: .version_select at 0x7f6fb53cfaf0>, body: {"keypair": {"name": "tempest-keypair-882525112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9zU6Ed3aqhSKohjhSxZfnPJi8nD5+xMi9Nilfrw1aDFbMqMjASEPapwF78t4y9T39j4zQrEkRBUJEwvmWkFFf6vuC95BF4wvNHpo5ZFu7MpvPsJ2BaxZiq87x+N26yjg=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:45.015896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-c0d3189e-65a2-40bd-ac23-f12cfdd302c2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:54:45.035449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-c0d3189e-65a2-40bd-ac23-f12cfdd302c2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:54:45.059393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:45.060019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:45.073389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:45.073851 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:45.074910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:45.075129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:45.208418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c0d3189e-65a2-40bd-ac23-f12cfdd302c2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.453596 May 25 14:54:45.209763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 7/14] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 14:54:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:45.587801 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:45.598320 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-98c7bb07-437b-4eff-ba72-e520e77ca870 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1219 microversion: 2.1 time: 0.544873 May 25 14:54:45.599180 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 8/15] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:45 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1219 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:46.626745 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:46.629696 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:46.656317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:46.657103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:46.659596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:46.662585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:47.183121 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:47.217097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3996c7c8-c8b3-41a4-8dec-ac7efc85e835 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1219 microversion: 2.1 time: 0.601207 May 25 14:54:47.235515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 8/16] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:46 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1219 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:48.234977 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:48.235639 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:48.260649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:48.261275 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:48.261900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:48.267629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:48.570507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:48.590152 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-dfad1fd5-1949-4030-a19a-474eeda99610 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1267 microversion: 2.1 time: 0.359172 May 25 14:54:48.591837 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 9/17] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:48 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:49.479462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:49.610571 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:49.612243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:49.647512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:49.648205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:49.649713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:49.650758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:49.807492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:49.817523 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f59e8280-4761-49aa-a175-5a2883234a66 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1285 microversion: 2.1 time: 0.212612 May 25 14:54:49.829460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 10/18] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:49 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:49.923090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7f131a3a-aaba-451f-a060-56cbf7809b35 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'create', calling method: .version_select at 0x7f6fb5386820>, body: {"keypair": {"name": "tempest-keypair-771342447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf257WIo/k53lq94xY4enzJo++5rf7Ff0ibDyeB9kcypZ+4028YBmle0Lre7Myg3Hin9xc4xOEzt7Ir5IpoaQLArav9PdjBXNE7qj+br/G3xqYTXNLKbIV8cwvQljL4Gg=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:49.975765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-7f131a3a-aaba-451f-a060-56cbf7809b35 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for project 18c8213736cf4113951fbb3520c18183. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:54:50.017369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-7f131a3a-aaba-451f-a060-56cbf7809b35 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for user 237510469a8e4e36ad40a34cdf705656 and project 18c8213736cf4113951fbb3520c18183. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:54:50.196123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7f131a3a-aaba-451f-a060-56cbf7809b35 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.726590 May 25 14:54:50.197398 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 9/19] 10.222.0.74 () {62 vars in 1199 bytes} [Wed May 25 14:54:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 729 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 14:54:50.848639 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:50.850832 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:50.888034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:50.888655 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:50.890151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:50.892540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:51.186709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=4 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:51.261444 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:51.276212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ad5ba79c-bed8-446f-8c20-2efaf17d8454 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1273 microversion: 2.1 time: 0.433490 May 25 14:54:51.287568 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 11/20] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:50 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1273 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:52.297370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:52.300277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:52.338216 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:52.342369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:52.344184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:52.346977 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:52.945746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:52.967401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9062719e-3c70-4a91-af46-5737cbe9a42d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1273 microversion: 2.1 time: 0.675682 May 25 14:54:52.968327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 10/21] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:52 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1273 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:53.827490 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1ed70888-36f9-4512-8cc8-814a10a73ea2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: .version_select at 0x7f6fb64c9310>, body: {"keypair": {"name": "tempest-keypair-858382302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzdumuETG3HTAjDxtNDzMjidfGJvfnNfnmSyui3Z0KQxONGzq5pJwy7ZER9c0aqrHX9TwW5NLLhe4Y6Zo4QiGmSQxYi52OTQRd11vSdqQUVn1R7+0aBjghw7rVinIzwrQ=="}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:53.987122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:53.988291 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:54.001128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-1ed70888-36f9-4512-8cc8-814a10a73ea2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:54:54.005173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:54.005173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:54.005173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:54.005173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:54.020724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-1ed70888-36f9-4512-8cc8-814a10a73ea2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for user 9dba831ebb584de5a0c84f39901d3c32 and project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:54:54.197760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1ed70888-36f9-4512-8cc8-814a10a73ea2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.963940 May 25 14:54:54.197760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 12/22] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 14:54:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:54:54.852628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:54.866081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b4978dc7-a032-48c4-bb1a-5ff1f376582f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.883401 May 25 14:54:54.875156 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 11/23] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:53 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:55.884982 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:55.886615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:55.918724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:55.919341 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:55.920328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:55.920932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:56.276525 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1365684853", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:56.384541 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.network.neutron [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] validate_networks() for [('1af7d524-3bf7-4e87-bf8e-df0a6b0097e3', None, None, None, None, None)] {{(pid=129908) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:54:56.705460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:56.717128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-981d765a-2b97-4c4c-ad6b-f56eaa854f40 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.836728 May 25 14:54:56.717675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 13/24] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:55 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:56.738944 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-355295907", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa952598-36d5-42ef-b4ac-0f4017a94969"}], "security_groups": [{"name": "tempest-securitygroup--1842594051"}], "key_name": "tempest-keypair-882525112", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:54:57.339663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] validate_networks() for [('fa952598-36d5-42ef-b4ac-0f4017a94969', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:54:58.363357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Flavor limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:54:58.364354 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Image limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:54:58.365068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Flavor pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:54:58.366116 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Image pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:54:58.367623 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:54:58.404195 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:58.411013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:58.418261 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:58.418261 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:58.476169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for project 9263e6d657dd458d9f497bb868adb941. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:54:58.508591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for user becb6feb52b643279066aef1a7a9f063 and project 9263e6d657dd458d9f497bb868adb941. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:54:58.619090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Going to run 1 instances... {{(pid=129908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:54:58.629957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:54:58.991709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-560f3c5f-42ba-484b-8995-141ec4c219fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.970384 May 25 14:54:58.995528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 12/25] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:54:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:54:59.007262 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:59.008577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:59.049759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:59.055486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:59.057548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:59.057548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:59.608284 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:54:59.608849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:54:59.609356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:54:59.610382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:54:59.611119 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:54:59.620401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:59.638942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e12fa9d3-0677-43b6-8557-93d38b8ae9ac tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.639159 May 25 14:54:59.640788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 13/26] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:58 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:59.652397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:59.668876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-01f78c2a-e16f-4c03-b7a5-9bee34caa57c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:54:59.669267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:59.669378 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-01f78c2a-e16f-4c03-b7a5-9bee34caa57c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:54:59.669471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:54:59.669471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:54:59.730016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:54:59.753449 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:54:59.754913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-01f78c2a-e16f-4c03-b7a5-9bee34caa57c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:54:59.760094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-01f78c2a-e16f-4c03-b7a5-9bee34caa57c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1222 microversion: 2.1 time: 0.114130 May 25 14:54:59.761419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 14/27] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:54:59 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:54:59.801116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:54:59.807808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:54:59.892542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1429961112", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:00.020754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.network.neutron [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] validate_networks() for [('1af7d524-3bf7-4e87-bf8e-df0a6b0097e3', None, None, None, None, None)] {{(pid=129908) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:55:00.153695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-61d1b594-3379-4791-80b9-90b2d292cce2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.425349 May 25 14:55:00.160147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 14/28] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:54:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:55:00.192968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-dacc6a4f-a4b7-4e0c-83da-b115ce15fb10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:00.193792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-dacc6a4f-a4b7-4e0c-83da-b115ce15fb10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:00.476561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-dacc6a4f-a4b7-4e0c-83da-b115ce15fb10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:00.508051 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-dacc6a4f-a4b7-4e0c-83da-b115ce15fb10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1240 microversion: 2.1 time: 0.340603 May 25 14:55:00.510134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 15/29] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:00 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1240 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:00.660457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:00.661304 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:00.699633 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:00.700163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:00.701308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:00.701829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:01.340034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:01.373259 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6dbabe74-875c-4976-998c-9826fbfde770 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.713741 May 25 14:55:01.378961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 16/30] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:00 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:01.385686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1109051550", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ddfa1ea-b411-4388-afb5-c29ffb748770"}], "security_groups": [{"name": "tempest-securitygroup--470864208"}], "key_name": "tempest-keypair-771342447", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:01.425555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Flavor limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:55:01.426866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Image limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:55:01.427574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Flavor pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:55:01.428176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Image pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:55:01.428813 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:55:01.447405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:01.449190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:01.451255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:01.457456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:01.488472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for project 9263e6d657dd458d9f497bb868adb941. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:55:01.493094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for user becb6feb52b643279066aef1a7a9f063 and project 9263e6d657dd458d9f497bb868adb941. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:55:01.506966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Going to run 1 instances... {{(pid=129908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:55:01.509349 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:55:01.658804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] validate_networks() for [('0ddfa1ea-b411-4388-afb5-c29ffb748770', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:55:01.692290 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d21d51fb-9f79-4c7f-9f25-fa7ffe3a1e00 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.809639 May 25 14:55:01.693221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 15/31] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:54:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:55:01.709446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2879e40a-d9b7-4355-8691-55b48e8f5497 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:01.711753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2879e40a-d9b7-4355-8691-55b48e8f5497 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:01.857678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2879e40a-d9b7-4355-8691-55b48e8f5497 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:01.866533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2879e40a-d9b7-4355-8691-55b48e8f5497 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1240 microversion: 2.1 time: 0.171410 May 25 14:55:01.869950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 16/32] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:01 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1240 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:01.873760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-70d80ea2-e827-4e5c-add7-a14204582b24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:01.874981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-70d80ea2-e827-4e5c-add7-a14204582b24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:02.038127 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-70d80ea2-e827-4e5c-add7-a14204582b24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:02.048691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-70d80ea2-e827-4e5c-add7-a14204582b24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1222 microversion: 2.1 time: 0.178513 May 25 14:55:02.049106 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 17/33] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:01 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:02.158669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-b7a8f764-1550-4370-97f4-c0ce141d56c6 req-cefa16ec-5ad1-428f-a922-3e5e3627ffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150d8545-ce77-41fa-9c4c-1d157e865b6c", "tag": "47a43853-cc46-4066-8e17-9a8712025b8e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:02.167649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:02.176361 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b7a8f764-1550-4370-97f4-c0ce141d56c6 req-cefa16ec-5ad1-428f-a922-3e5e3627ffa6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.176942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b7a8f764-1550-4370-97f4-c0ce141d56c6 req-cefa16ec-5ad1-428f-a922-3e5e3627ffa6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.213188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-b7a8f764-1550-4370-97f4-c0ce141d56c6 req-cefa16ec-5ad1-428f-a922-3e5e3627ffa6 service nova] Creating event network-changed:47a43853-cc46-4066-8e17-9a8712025b8e for instance 150d8545-ce77-41fa-9c4c-1d157e865b6c on hv-cinder-83028 May 25 14:55:02.214011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b7a8f764-1550-4370-97f4-c0ce141d56c6 req-cefa16ec-5ad1-428f-a922-3e5e3627ffa6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 14:55:02.215467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.219324 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.220437 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.221146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.233480 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.compute.rpcapi [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 14:55:02.234874 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=129908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 14:55:02.251832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7a7ef770-253f-46c7-8480-6dac1083b8b2 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201049 May 25 14:55:02.252441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:02.391355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:02.392315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:02.400803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.401541 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.402552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.403614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.857241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:02.878965 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:55:02.879449 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:55:02.880075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:55:02.880527 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:55:02.880953 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:55:02.881840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-98867faa-4606-4902-ba0b-8602b886303a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.491439 May 25 14:55:02.916148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 19/35] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:02 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:02.916589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.916589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.916589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.916589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.916896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:02.916896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:02.920961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.921588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.924033 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:02.926302 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:02.943647 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for project 18c8213736cf4113951fbb3520c18183. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:55:02.950296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for user 237510469a8e4e36ad40a34cdf705656 and project 18c8213736cf4113951fbb3520c18183. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:55:02.979358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:55:02.982861 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:55:03.134207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:03.174440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b543c451-ed70-4368-90e1-b3560c43ba7b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.278356 May 25 14:55:03.190483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 20/36] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:02 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:03.210280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:03.211074 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:03.227912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:03.229877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:03.230767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:03.231219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:03.315218 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-55b22cd3-3ad0-4441-a79d-dce5317ec3f2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.934603 May 25 14:55:03.315871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 17/37] 10.222.0.74 () {62 vars in 1187 bytes} [Wed May 25 14:55:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 14:55:03.336749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-72968386", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebc02943-e245-4287-8851-2c76f257286a"}], "security_groups": [{"name": "tempest-securitygroup--1705463185"}], "key_name": "tempest-keypair-858382302", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:03.418676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:03.449571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-70b7d599-0905-4bf5-b476-a59885eb4612 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.256545 May 25 14:55:03.450498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 21/38] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:03 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:03.462128 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fbf7673d-d9b5-4145-9bc8-53acceedd03c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:03.463174 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fbf7673d-d9b5-4145-9bc8-53acceedd03c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:03.599649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fbf7673d-d9b5-4145-9bc8-53acceedd03c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:03.607559 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fbf7673d-d9b5-4145-9bc8-53acceedd03c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:03.611206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] validate_networks() for [('ebc02943-e245-4287-8851-2c76f257286a', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:55:03.613744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fbf7673d-d9b5-4145-9bc8-53acceedd03c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:03.614939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fbf7673d-d9b5-4145-9bc8-53acceedd03c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1281 microversion: 2.20 time: 0.163035 May 25 14:55:03.629279 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 22/39] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:03 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:03.898931 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:03.899865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:03.914250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:03.917356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:03.919536 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:03.920006 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:03.926342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=59 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:04.117151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:55:04.117636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:55:04.118175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:55:04.118702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:55:04.119169 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:55:04.128439 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:04.128897 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:04.131107 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:04.131107 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:04.139226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.146681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dbb9b94f-d2be-4cdf-9f75-d123d18657c0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.251734 May 25 14:55:04.147253 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 23/40] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:03 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:04.147754 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:55:04.156476 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for user 9dba831ebb584de5a0c84f39901d3c32 and project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:55:04.168867 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:55:04.171030 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:55:04.194575 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:04.195233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:04.210802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:04.211164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:04.211957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:04.212645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:04.340465 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.349301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5541ff25-1e48-422c-8cfb-bbd778efd0e6 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.027628 May 25 14:55:04.352737 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 18/41] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:55:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:55:04.354023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-381aa2a6-1ce6-43ad-8b76-7e2908024757 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.164894 May 25 14:55:04.357848 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 24/42] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:04 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:04.396777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-215ffcd1-a58e-43c0-846e-7ff667cd27d0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:04.397407 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-215ffcd1-a58e-43c0-846e-7ff667cd27d0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:04.472495 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:04.473380 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:04.480961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:04.481574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:04.482513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:04.483309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:04.539297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-215ffcd1-a58e-43c0-846e-7ff667cd27d0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.550732 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-215ffcd1-a58e-43c0-846e-7ff667cd27d0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1235 microversion: 2.1 time: 0.180799 May 25 14:55:04.552785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 19/43] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:04 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1235 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:04.610548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.623099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7e66d2f4-dda9-443f-ba3d-b881b4988e97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.151255 May 25 14:55:04.623917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 25/44] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:04 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:04.640610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-82581ade-c1ec-44a7-a6e7-823f66cf38d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:04.641992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-82581ade-c1ec-44a7-a6e7-823f66cf38d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:04.651522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:04.725077 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-82581ade-c1ec-44a7-a6e7-823f66cf38d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.733185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-82581ade-c1ec-44a7-a6e7-823f66cf38d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.735121 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-82581ade-c1ec-44a7-a6e7-823f66cf38d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:04.736244 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-82581ade-c1ec-44a7-a6e7-823f66cf38d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1281 microversion: 2.20 time: 0.099803 May 25 14:55:04.738189 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 20/45] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:04 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:05.162839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:05.163527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:05.174753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.179286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.179286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.179286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.322937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.331648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-91da8f91-ebcb-4305-b0db-cc13337b33c5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.172643 May 25 14:55:05.332238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 26/46] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:05 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:05.373590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:05.374575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:05.399162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.401229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.402450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.403350 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.477504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.481913 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e0393407-47cf-413c-9fc1-1bd5a821c4f4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.113510 May 25 14:55:05.482714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 21/47] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:05 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:05.576884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:05.577724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:05.585091 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.586302 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.587299 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.587739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.640985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:05.641640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:05.649745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.650280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.651244 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.651739 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.660055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.671279 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fed64180-6cc6-438b-8dd3-bdbbc364397f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.106095 May 25 14:55:05.673054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 27/48] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:05 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:05.731095 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.742464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5169dfe5-c062-49be-9470-f541fdf2a265 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.105344 May 25 14:55:05.743495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 22/49] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:05 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:05.759133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:05.760320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:05.772802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.773538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.774918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:05.775299 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:05.846454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.861863 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.866789 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:05.868271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-28ff29f2-a9db-4c05-b35d-a9278254786e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.117157 May 25 14:55:05.869231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 28/50] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:05 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:06.350882 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:06.350882 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:06.356021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.356481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.357357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.357899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.499822 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:06.501607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:06.513332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.517100 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.517794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.519224 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.519985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.528044 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-829e0cfb-eaf4-4c30-9a07-bb5e17831814 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.183803 May 25 14:55:06.529293 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 23/51] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:06 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:06.605918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.615332 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7e90ff4a-236a-40f1-8908-e4ec78359a57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.119401 May 25 14:55:06.616417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 29/52] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:06 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:06.689890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:06.690528 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:06.697767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.698504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.699547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.700207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.759546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:06.760718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:06.770005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.770391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.770593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.771518 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.771958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.781830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-611d2eac-4064-4ab6-9a8e-a20541da6262 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.096240 May 25 14:55:06.782911 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 24/53] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:06 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:06.852172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.860711 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-48a79d66-b9e1-431d-bb02-28391c3b3509 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.104257 May 25 14:55:06.861505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 30/54] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:06 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:06.888933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:06.889558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:06.896153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.896610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.897403 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:06.898024 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:06.965693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.973842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.978685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:06.978685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-45881bae-892c-4f8d-90e1-2fc8ca5cfaca tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.091934 May 25 14:55:06.978685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 25/55] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:06 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:07.548413 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:07.549237 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:07.555855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.556508 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.563005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.563005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.639776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:07.640410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:07.651711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.655022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.655872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.656327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.661925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=79 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:07.748753 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:07.756239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e58f637f-7840-4823-98d0-a5440d626cac tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.122042 May 25 14:55:07.761037 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:07.761176 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 26/56] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:07 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:07.764097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-97eedef0-c497-4ec3-bb93-e156d530799a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.222189 May 25 14:55:07.764660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 31/57] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:07 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:07.798219 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:07.798859 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:07.805144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.805706 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.806589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.807109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.872176 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:07.876690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:07.877312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:07.879989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-16729104-0132-4d5a-80c7-6f351498b1d9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.085650 May 25 14:55:07.880773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 27/58] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:07 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:07.883540 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.884094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.884948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:07.885535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:07.946443 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:07.954489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b7b45e8c-73d9-4cc8-8c9b-bc7d5862ea3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.081930 May 25 14:55:07.955073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 32/59] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:07 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:07.995208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:07.995820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:08.002459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.002939 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.003696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.004133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.065729 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:08.073994 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:08.075580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:08.076745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1816ab5d-939c-4e92-95a4-9814c7905bc6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.085529 May 25 14:55:08.077300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 28/60] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:07 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:08.773630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:08.774406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:08.781479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.782017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.782124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:08.783277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:08.783416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.784028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.789347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.789800 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.790580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.791219 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.896323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:08.906108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-87714d18-db9a-42bd-b127-ee0b1feff1ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.135938 May 25 14:55:08.907247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 33/61] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:08 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:08.915756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:08.916821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:08.924657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.926783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:08.926783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:08.926783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.020584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.029001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-751dcf4d-5a99-4325-93fa-9f9e463eb69a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.250622 May 25 14:55:09.029805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 29/62] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:08 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:09.039636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:09.040385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:09.042419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.048388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:09.050424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.051324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:09.051606 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4478b838-56e5-44b0-9e2d-d83cd24f8920 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.142701 May 25 14:55:09.051893 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.052191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 34/63] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:08 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:09.096026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:09.096683 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:09.103239 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:09.103693 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.107569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:09.108018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.117916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.125590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1eed0073-689d-4766-a252-22dfe1a2ffa1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.090338 May 25 14:55:09.126177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 30/64] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:09 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:09.179293 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.187797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.189948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.191265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cfd6daac-66d7-434a-a91a-a0008e274baa tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.099815 May 25 14:55:09.194691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 35/65] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:09 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:09.924254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:09.924940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:09.931130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:09.931520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.932268 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:09.932700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:09.992436 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:09.999911 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-94c4bed9-607b-4adf-9b34-ded820262a11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.079458 May 25 14:55:10.000379 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 31/66] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:09 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:10.046376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:10.047016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:10.053114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.053621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.054424 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.054932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.069114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:10.069867 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:10.075933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.076437 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.077216 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.077657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.149773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:10.157453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-aec13f4a-02b9-42ae-a719-ddd94b41c0b5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.092515 May 25 14:55:10.158027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 32/67] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:10 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:10.163188 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:10.165390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:10.170627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.171238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.172131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.172643 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.214111 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:10.221971 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9bad6b91-e39e-444d-95d6-94f755b1d068 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.179202 May 25 14:55:10.232042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 36/68] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:10 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:10.232042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:10.232042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:10.234090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.234665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.235738 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:10.236369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:10.242257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:10.250433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-203ea96f-698b-4ce7-b18a-1737201cd993 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.091290 May 25 14:55:10.251064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 33/69] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:10 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:10.298485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:10.306899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:10.308430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:10.309554 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-54c299f7-ba11-47b7-a0a2-af2b8e4b5c90 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.085947 May 25 14:55:10.310198 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 37/70] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:10 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:11.015640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:11.016258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:11.022323 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.022822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.023595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.024040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.090707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.092084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-39f71739-f114-409f-8cfe-e519e2b88568 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.080438 May 25 14:55:11.092648 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 34/71] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:11 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:11.175500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:11.176151 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:11.182347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.182844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.183622 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.184064 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.240461 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:11.241079 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:11.244116 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.247517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.248137 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.249087 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.249594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.252366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0735233b-2b70-4adc-b1e2-8ad6e32e7bc0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.081358 May 25 14:55:11.253155 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 38/72] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:11 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:11.267839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:11.268451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:11.276071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.276514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.277278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.277706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.349701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.352427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:11.359139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9ed9a0f1-91c5-4445-943d-75c03f18f8d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.094810 May 25 14:55:11.360741 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 39/73] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:11 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:11.364936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:11.365720 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:11.371856 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.374535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.374535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:11.374535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:11.423016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.430872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-18b6b5b8-1cb6-4157-aa8f-fff4f596d8af tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.195065 May 25 14:55:11.431538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 35/74] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:11 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:11.438791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.447345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.448849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:11.453364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3ea23885-9dc0-4112-bb64-92701cb5dbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.088898 May 25 14:55:11.453364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 40/75] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:11 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:12.109641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:12.110852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:12.118675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.122524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.122524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.122524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.214816 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.222563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-385e5526-65e3-429e-b6e6-c878f705dc37 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1244 microversion: 2.1 time: 0.117222 May 25 14:55:12.223189 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 36/76] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:12 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1244 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:12.268925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:12.275618 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:12.275618 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=6 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:12.276343 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.276791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.277555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.277991 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.351276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.358955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b4f7e76e-8159-4473-9aa8-4afec19813d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1239 microversion: 2.1 time: 0.093951 May 25 14:55:12.359559 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 41/77] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:12 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:12.376114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:12.376724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:12.383415 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.383872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.384678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.385128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.449202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:12.449828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:12.456730 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.457254 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.457611 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.457870 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.458314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.468889 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f17e1399-4989-442e-8021-5dc875e01ade tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1226 microversion: 2.1 time: 0.096745 May 25 14:55:12.469649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 37/78] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:12 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:12.474880 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:12.475487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:12.484634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.484634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.485334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:12.485837 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:12.577784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.593554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.595115 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.596434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4aa3291c-488b-494f-9f82-21051c45173c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1285 microversion: 2.20 time: 0.125886 May 25 14:55:12.597817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 38/79] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:12 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:12.643029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:12.650801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4be7c084-4de0-4ee4-abaa-751283be2691 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.206407 May 25 14:55:12.651376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 42/80] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:12 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:13.239746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:13.240469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:13.246886 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.248039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.248160 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.248554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.319473 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.338716 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e582d2d2-af22-40c2-9c37-3ab28100c87f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1292 microversion: 2.1 time: 0.092306 May 25 14:55:13.338716 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 39/81] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:13 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:13.376565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:13.377177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:13.383923 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.384335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.385099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.385529 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.447000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.454945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b19e3ed2-5e61-4a2c-9a36-23fea9f471f5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1287 microversion: 2.1 time: 0.082314 May 25 14:55:13.455516 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 43/82] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:13 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:13.505281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:13.505281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:13.505281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.505281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.505566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.505566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.561015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.569326 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0ce9fc7a-1c07-48c3-bfdc-03ccc7c44800 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1274 microversion: 2.1 time: 0.087317 May 25 14:55:13.569896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 40/83] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:13 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:13.615658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:13.616384 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:13.618341 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=36 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:13.624364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.624830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.625689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.626126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.667242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:13.668892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:13.681000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.681666 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.682892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:13.683671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:13.701890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.711987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.716949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.718322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2d9ad53a-4e4b-46ba-870e-75cdf5adf48c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1333 microversion: 2.20 time: 0.106952 May 25 14:55:13.719393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 44/84] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:13 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:13.851415 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:13.858812 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8986d76a-1d71-460a-a7c9-9695b796420d tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.195483 May 25 14:55:13.859374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 41/85] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:13 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:14.345630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:14.346249 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:14.355560 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.356119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.356759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.357597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.478124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:14.478777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:14.482571 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:14.493885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.494372 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.495506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.503383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.558076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:14.571161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6e8bf16f-a8a8-475f-9ce4-e9d4ea1d1187 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1310 microversion: 2.1 time: 0.227667 May 25 14:55:14.573168 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 45/86] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:14 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1310 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:14.586194 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:14.588697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:14.599505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.599995 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.601967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.602421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.729931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=28 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:14.746608 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:14.749052 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:14.762701 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0bf025bb-ba2b-4c98-b1a7-ebf43cf51c47 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1295 microversion: 2.1 time: 0.293617 May 25 14:55:14.771680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 42/87] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:14 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1295 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:14.774501 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:14.775142 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:14.782000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.782457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.785235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.785814 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.838424 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:14.851783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-de7c5a57-f4e0-40c7-877e-16f29d8c0235 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1282 microversion: 2.1 time: 0.269442 May 25 14:55:14.863497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 46/88] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:14 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:14.877499 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:14.878190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:14.884369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.884811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.885578 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:14.886164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:14.902327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:14.928344 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:14.937416 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:14.938526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-06da8d7f-9329-4c60-a82c-077b2f74ded1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1333 microversion: 2.20 time: 0.174307 May 25 14:55:14.939804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 43/89] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:14 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1333 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:15.402981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:15.413023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-72bce75e-b148-4e25-addc-252c6c594e6c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.538942 May 25 14:55:15.435759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 47/90] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:14 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:15.590234 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:15.590234 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:15.596138 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.596856 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.597847 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.598349 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.697777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:15.709334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-86350c40-577f-4608-bd1c-9f6425284ecc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1298 microversion: 2.1 time: 0.120656 May 25 14:55:15.709334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 44/91] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:15 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:15.781236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:15.781860 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:15.789488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.790102 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.791376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.792056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.869667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:15.870607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:15.877380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.878467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.879615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.880288 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.966720 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:15.975406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6d999f17-e1b9-4988-8406-a18714d9d6ee tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1293 microversion: 2.1 time: 0.198090 May 25 14:55:15.985238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 48/92] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:15 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1293 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:15.991101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:15.991717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:15.997780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:15.998531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:15.999519 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.000258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.008270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:16.027927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a7fc30f7-aef2-4fb9-a929-3cd5027a6d82 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1280 microversion: 2.1 time: 0.162206 May 25 14:55:16.029254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 45/93] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:15 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:16.094446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:16.103222 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:16.105050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:16.106982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-74136041-1e27-432e-b66e-2c8563792e0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1351 microversion: 2.20 time: 0.120357 May 25 14:55:16.121431 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 49/94] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:15 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:16.430775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:16.431649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:16.440829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.442281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.443500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.444171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.699219 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:16.708653 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9db2d1e4-8cab-4ac0-a3d0-c8618a36101f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.282403 May 25 14:55:16.713575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 46/95] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:16 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:16.725004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:16.725952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:16.743499 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.746053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.746053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:16.746053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:16.992213 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:16.992959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:17.004810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.005268 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.006079 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.006525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.072096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.081719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e5ff24e7-123e-493a-901b-b7f135e0422f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.360560 May 25 14:55:17.082312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 50/96] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:16 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:17.095723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:17.096619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:17.104918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.106157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.107469 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.108140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.249826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.258992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7d8a016d-ff70-4870-886d-06eef2a4a624 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.270885 May 25 14:55:17.259581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 47/97] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:16 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:17.271835 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:17.272624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:17.280041 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.280682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.281610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.282198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.330043 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.342610 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-59661d70-977b-41fd-a3d6-878f0b708fef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.258782 May 25 14:55:17.356420 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 51/98] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:17 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:17.373983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.382824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.384342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.385479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b34dec62-00e2-40a4-b102-c33ded82b9ea tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1351 microversion: 2.20 time: 0.124815 May 25 14:55:17.386039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 48/99] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:17 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:17.726434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:17.727151 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:17.733181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.733628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.734385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:17.734845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:17.882736 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:17.890295 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c8153f14-9900-41a8-97c4-349dc31f588a tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.168486 May 25 14:55:17.891396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 52/100] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:17 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:18.100558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:18.101248 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:18.107885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.108500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.109337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.109773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.253308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:18.260811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-290a6e8f-540a-4765-997f-34905f830aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.166735 May 25 14:55:18.261380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 49/101] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:18 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:18.276664 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:18.277316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:18.283410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.283877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.285288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.285733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.371997 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:18.372602 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:18.378870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.379525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.380306 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.380749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.416035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:18.423723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1229787b-0c9b-4706-a987-a52c985645be tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.150878 May 25 14:55:18.424292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 53/102] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:18 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:18.428939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:18.429618 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:18.435611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.436055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.436858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.437288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.515056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:18.524810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:18.526733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:18.528219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3283a75a-c945-406b-9172-62719ad0865b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1351 microversion: 2.20 time: 0.102861 May 25 14:55:18.532831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 54/103] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:18 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:18.546708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:18.554274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-11cf3193-edbc-4dd6-8476-8f33f0c4de2f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.186171 May 25 14:55:18.554868 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 50/104] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:18 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:18.906885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:18.908301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:18.914103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.914556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:18.915366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:18.915931 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.098905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.106487 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-886bbec4-104a-4bf9-9a21-2cc79c78e752 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.203734 May 25 14:55:19.107078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 55/105] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:18 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:19.277566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:19.278797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:19.285506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.285950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.286749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.287181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.440065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:19.441988 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:19.447048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.448404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.448924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.449823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.450323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.454411 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2bc9964d-c8a0-4149-9378-26d23ecb0d21 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.181015 May 25 14:55:19.458872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 51/106] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:19 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:19.466579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:19.545644 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:19.546249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:19.552878 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.553370 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.554376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.554678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.583293 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.591030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6cc8f57d-ff57-4e70-88bf-b7f032e8ae57 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.155066 May 25 14:55:19.591756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 56/107] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:19 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:19.597558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:19.598618 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:19.605171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.605626 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.606412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:19.606876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:19.623217 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.632506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.634039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.635147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7da4efd3-1e8a-47a2-8605-4de2f5e9c55a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1351 microversion: 2.20 time: 0.093393 May 25 14:55:19.635908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 52/108] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:19 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:19.897796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:19.906853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0fbf6e79-cb7b-4798-afd5-0b1a9aa21d6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.311446 May 25 14:55:19.906853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 57/109] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:19 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:20.124053 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:20.124671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:20.130701 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.131318 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.132091 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.132534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.272304 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:20.280555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1230af59-3983-42c9-af9d-201aacd1fd00 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.160423 May 25 14:55:20.289117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 53/110] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:20 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:20.473102 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:20.473708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:20.480043 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.480489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.482876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.482876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.607732 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:20.608343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:20.614656 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.615117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.615896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.616633 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.619409 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:20.628355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-330d43fa-8fd0-492a-8c9e-bd501990459d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.159984 May 25 14:55:20.630553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 58/111] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:20 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:20.654018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:20.654629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:20.667573 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.668144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.669158 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.669751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.746157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:20.754202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:20.755739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:20.756845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8e535bad-3832-48f8-b042-3a4665f8f2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1351 microversion: 2.20 time: 0.107466 May 25 14:55:20.757445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 59/112] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:20 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:20.780855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:20.788447 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-afd159f2-a11e-4dcb-bd85-3688e198b2c7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.184563 May 25 14:55:20.789002 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 54/113] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:20 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:20.922585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:20.923247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:20.929357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.929787 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:20.930594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:20.931207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.073248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.081022 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3dbe41da-3785-4261-b4f9-b4c7040f1393 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.162194 May 25 14:55:21.081656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 60/114] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:20 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:21.299394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:21.301060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:21.308321 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.308899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.310149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.310817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.457363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.469027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b9fdcae4-dd5c-452b-9138-e880550093aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.175081 May 25 14:55:21.474867 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 55/115] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:21 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:21.646657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:21.647849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:21.654505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.655144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.655927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.656365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.775158 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:21.776035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:21.784883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.791690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.791690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.791690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.797128 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.806191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-31c3b70a-47e9-4ea8-ab67-2c8842190f28 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.163989 May 25 14:55:21.807005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 61/116] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:21 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:21.821951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:21.822573 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:21.829272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.829732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.830568 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:21.831494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:21.861293 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.869745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.871303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.872413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e1186d9f-a56e-4cbf-b79a-ee7037a3172d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1351 microversion: 2.20 time: 0.101610 May 25 14:55:21.872975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 56/117] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:21 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:21.969434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:21.977858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-34511640-e258-4f4a-aa74-82dd622113b8 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.159568 May 25 14:55:21.987159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 62/118] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:21 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:22.099243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:22.099886 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:22.107786 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:22.108249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:22.109042 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:22.109485 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:22.443359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:22.454046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0e054add-a1a1-4286-80a2-d087e9eb4cef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.359411 May 25 14:55:22.455010 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 57/119] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:22 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:22.488428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:22.489106 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:22.495852 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:22.496682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:22.497791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:22.498458 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:22.822999 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:22.823793 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:22.830124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:22.830574 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:22.831421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:22.831856 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:22.915744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:22.947704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fa567340-6072-40d9-89ec-965e388dd450 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.463338 May 25 14:55:22.956725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 63/120] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:22 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:22.975398 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:22.976196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:23.009807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.010267 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.013258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.015442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.174713 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:23.184070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:23.186041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:23.187281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7f78015f-882e-429f-8e32-b88485f78657 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1339 microversion: 2.20 time: 0.229357 May 25 14:55:23.188039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 64/121] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:22 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:23.196938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:23.209076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:23.213354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-179e4988-da91-4ccc-983e-a457aee0e2d9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.394091 May 25 14:55:23.214218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:23.216443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 58/122] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:22 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:23.221807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.222255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.223133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.223721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.431002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:23.452592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-aaf025a7-0a5f-4846-a33d-75def0aaf935 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.262695 May 25 14:55:23.454824 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 65/123] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:23 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:23.474779 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:23.479734 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:23.484046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.484496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.485338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.485838 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.529725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:23.969115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:23.969721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:23.981588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.983126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:23.984679 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:23.985355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.193113 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:24.229480 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d5ca9223-a052-42d9-be1c-1e91176476fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.759243 May 25 14:55:24.233223 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 59/124] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:23 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:24.249092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:24.253306 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:24.272952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.276423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.277915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.279814 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.480595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:24.501948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8b5fb876-d0e2-4745-af66-8c32053216b5 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.536391 May 25 14:55:24.503721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 66/125] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:23 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:24.551192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:24.552137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:24.560458 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:24.568453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.570371 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.571359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.572203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.653773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:24.667478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:24.671460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:24.674232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-66a128d6-e645-45e6-8426-e0a1084d0fd7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.439658 May 25 14:55:24.676979 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 60/126] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:24 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:24.696728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-e9b19ee8-5c6a-4e8a-a5c3-3f33d8478558 req-5c603575-e083-4f0c-893b-65e13eccf828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c1f5bd-4a13-4a35-9607-5bbff2d886e0", "tag": "e4ee92ba-bfd1-4a4a-94b6-1a50990a69b8"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:24.736071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e9b19ee8-5c6a-4e8a-a5c3-3f33d8478558 req-5c603575-e083-4f0c-893b-65e13eccf828 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.736720 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e9b19ee8-5c6a-4e8a-a5c3-3f33d8478558 req-5c603575-e083-4f0c-893b-65e13eccf828 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.793266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-e9b19ee8-5c6a-4e8a-a5c3-3f33d8478558 req-5c603575-e083-4f0c-893b-65e13eccf828 service nova] Creating event network-changed:e4ee92ba-bfd1-4a4a-94b6-1a50990a69b8 for instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 on hv-cinder-83028 May 25 14:55:24.806516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e9b19ee8-5c6a-4e8a-a5c3-3f33d8478558 req-5c603575-e083-4f0c-893b-65e13eccf828 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129907) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 14:55:24.809619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.810436 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.814308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.814973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.838365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.compute.rpcapi [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 14:55:24.839759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] Releasing lock "compute-rpcapi-router" {{(pid=129907) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 14:55:24.876281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4c0234db-64e7-4ff1-9f19-8389f3794202 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197278 May 25 14:55:24.877292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 61/127] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:24.884906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:24.887388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:24.905551 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.906277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:24.908728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:24.913908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.397300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.405894 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9aedb08d-cdba-4161-890a-87ffdb3514bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.900862 May 25 14:55:25.416821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 67/128] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:24 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:25.470459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.483113 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6b7edc06-2914-4606-a6ba-53d0c5716b48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.600003 May 25 14:55:25.483113 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 62/129] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:24 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:25.485421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:25.486203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:25.494719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.495345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.497076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.497673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.523888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-762aa25b-74a8-4b14-8edb-8ff975666386 req-39e1c204-d223-42d9-8223-472d25db6f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed", "tag": "1adf867b-8b01-47c8-9071-efb5a796ac50"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:25.534454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-762aa25b-74a8-4b14-8edb-8ff975666386 req-39e1c204-d223-42d9-8223-472d25db6f88 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.535186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-762aa25b-74a8-4b14-8edb-8ff975666386 req-39e1c204-d223-42d9-8223-472d25db6f88 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.546514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-762aa25b-74a8-4b14-8edb-8ff975666386 req-39e1c204-d223-42d9-8223-472d25db6f88 service nova] Creating event network-changed:1adf867b-8b01-47c8-9071-efb5a796ac50 for instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed on hv-cinder-83028 May 25 14:55:25.552463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-762aa25b-74a8-4b14-8edb-8ff975666386 req-39e1c204-d223-42d9-8223-472d25db6f88 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132607 May 25 14:55:25.553322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 68/130] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:25.558889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:25.564518 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:25.576337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.576337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.576828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.577342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.693319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.703956 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2117a14f-9a95-44af-b103-823db18f1d88 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.222982 May 25 14:55:25.704869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 63/131] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:25 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:25.718199 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:25.719077 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:25.731207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.733394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.734529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:25.739719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:25.759288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.778567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3b6c139a-861b-47b9-8347-7177981808ee tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.223814 May 25 14:55:25.779493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 69/132] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:25 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:25.923353 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.933575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.935238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:25.936232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-97199c19-3a31-440e-8837-885fee33db7f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.229696 May 25 14:55:25.941992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 64/133] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:25 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:26.423550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:26.424193 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:26.430786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.431238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.432011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.432445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.499485 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:26.504489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:26.507900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.508361 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.509148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.509592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.605493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:26.617347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-72f6708e-c4c5-488f-8a57-e02209d72f1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.197550 May 25 14:55:26.618025 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 70/134] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:26 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:26.670294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:26.679297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b507bd07-6251-45e4-8b0f-28ea240981e4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.185467 May 25 14:55:26.679883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 65/135] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:26 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:26.722190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:26.722839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:26.728803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.729250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.730010 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.730446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.796337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:26.797542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:26.804261 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.804722 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.805509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.805949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.894495 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:26.902172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-74a562fc-a670-4c79-84af-9d4cab691a67 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.184327 May 25 14:55:26.902832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 71/136] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:26 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:26.956976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:26.957601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:26.959267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:26.963796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.964247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.965102 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.965790 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:26.967800 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7dc01fb5-0094-4c3c-8a5a-a73607ed1c13 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.175079 May 25 14:55:26.977802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 66/137] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:26 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:26.977802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-703e27b6-d5cf-48db-aa28-79c2d5d7ac6d req-056a661b-6fdf-4ad8-a092-f919a1a3002d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d026df3e-764d-4346-8f57-3439f8239339", "tag": "ea7e1e22-9f9c-40eb-968a-be0fb1f82f9b"}, {"name": "network-changed", "server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:26.990675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-703e27b6-d5cf-48db-aa28-79c2d5d7ac6d req-056a661b-6fdf-4ad8-a092-f919a1a3002d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:26.991131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-703e27b6-d5cf-48db-aa28-79c2d5d7ac6d req-056a661b-6fdf-4ad8-a092-f919a1a3002d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.012614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-703e27b6-d5cf-48db-aa28-79c2d5d7ac6d req-056a661b-6fdf-4ad8-a092-f919a1a3002d service nova] Creating event network-changed:ea7e1e22-9f9c-40eb-968a-be0fb1f82f9b for instance d026df3e-764d-4346-8f57-3439f8239339 on hv-cinder-83028 May 25 14:55:27.017799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-703e27b6-d5cf-48db-aa28-79c2d5d7ac6d req-056a661b-6fdf-4ad8-a092-f919a1a3002d service nova] Creating event network-changed:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 14:55:27.030940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-703e27b6-d5cf-48db-aa28-79c2d5d7ac6d req-056a661b-6fdf-4ad8-a092-f919a1a3002d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060023 May 25 14:55:27.031695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 67/138] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:27.162993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:27.171002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:27.172597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:27.173874 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-24f0d26b-af81-475b-8cad-b18502f4eb26 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.221042 May 25 14:55:27.174520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 72/139] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:26 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:27.579866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-0e1e2cba-4eed-4402-bc0b-3a6b29e90c65 req-f7e1cb31-97b1-4014-b53e-af255939a301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64837a10-d6e9-4fde-9766-7c03759eae0a", "tag": "17a70972-093e-43d6-a189-0a0186e2adeb"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:27.590878 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-0e1e2cba-4eed-4402-bc0b-3a6b29e90c65 req-f7e1cb31-97b1-4014-b53e-af255939a301 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.591371 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-0e1e2cba-4eed-4402-bc0b-3a6b29e90c65 req-f7e1cb31-97b1-4014-b53e-af255939a301 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.602386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-0e1e2cba-4eed-4402-bc0b-3a6b29e90c65 req-f7e1cb31-97b1-4014-b53e-af255939a301 service nova] Creating event network-changed:17a70972-093e-43d6-a189-0a0186e2adeb for instance 64837a10-d6e9-4fde-9766-7c03759eae0a on hv-cinder-83028 May 25 14:55:27.607627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-0e1e2cba-4eed-4402-bc0b-3a6b29e90c65 req-f7e1cb31-97b1-4014-b53e-af255939a301 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031899 May 25 14:55:27.608197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 68/140] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:55:27.634322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:27.635592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:27.641942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.642315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.643781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.644269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.697927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:27.699005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:27.709189 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.709939 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.711305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.711812 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.918737 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:27.927412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ea4b0d9b-b8a5-478e-9534-0dd1c3661193 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.234119 May 25 14:55:27.927988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 69/141] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:27 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:27.932728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:27.933328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:27.937131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:27.939669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.940700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.941724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.942153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.956722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:27.959242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:27.965073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2cb05d0a-8f95-4faa-bf9f-036d874046b1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.334729 May 25 14:55:27.965673 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 73/142] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:27 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:27.985265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:27.985887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:27.993678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.994202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:27.995118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:27.995659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:28.145390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:28.153795 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ca63aa9d-1e7a-400a-bd1b-47716df71a07 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.224586 May 25 14:55:28.154537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 70/143] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:27 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:28.176130 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:28.183545 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4a6a5e91-639b-4e2d-ada3-10fabd632025 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.202106 May 25 14:55:28.184106 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 74/144] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:27 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:28.192108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:28.192825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:28.198846 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:28.199287 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:28.200066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:28.200532 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:28.346672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:28.354890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:28.356399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:28.357492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ea364bd2-e842-4f80-83b0-93804289d20c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.169766 May 25 14:55:28.358050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 71/145] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:28 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:28.945692 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:28.946326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:28.952489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:28.952928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:28.953691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:28.954115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:28.981992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:28.983332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:28.991124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:28.991652 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:28.992577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:28.993090 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.146284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.154049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dff7bf7c-c326-4239-b776-080d4e79022e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.212688 May 25 14:55:29.155531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 75/146] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:28 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:29.175938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.183781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7e7679ef-b34b-4ed2-8607-4d0cb938c050 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.205579 May 25 14:55:29.184343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 72/147] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:28 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:29.186858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:29.187490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:29.194176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:29.194618 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.195404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:29.196140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.201642 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:29.202544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:29.210215 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:29.210851 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.211964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:29.212563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.571351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.580753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bd0e0fc0-ce46-413f-a7f6-0a3d2fb5e2b5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.397590 May 25 14:55:29.581333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 76/148] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:29 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:29.593985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:29.596576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:29.610337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:29.611137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.613926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:29.614560 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:29.860799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.869110 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f3cc9cc6-0c69-421c-8d10-3c693b24d0c1 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.671680 May 25 14:55:29.869686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 73/149] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:29 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:29.948344 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.957434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.958957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:29.961306 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f97b44bf-8f9d-49a4-9d2b-92b9145ae54d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.372046 May 25 14:55:29.961306 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 77/150] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:29 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:30.171443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:30.175526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:30.179561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.180001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.180929 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.181380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.201699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:30.202664 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:30.209616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.210361 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.211638 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.212670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.503212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:30.511181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e35602cb-386e-41ad-922a-2354fb87a309 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.343289 May 25 14:55:30.516629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 74/151] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:30 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:30.563400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:30.581520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d922af9f-e023-4073-9025-2fab056dfdaa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.384084 May 25 14:55:30.582364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 78/152] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:30 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:30.598190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:30.598907 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:30.605790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.606255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.607288 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.607980 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.750426 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:30.757840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-59baa2fb-4b8f-49ad-859e-636ab3499370 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.164475 May 25 14:55:30.758406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 75/153] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:30 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:30.885891 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:30.886428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:30.892442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.893397 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.894151 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.894602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.978172 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:30.978834 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:30.984875 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.985322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:30.986083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:30.986520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.035110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.042546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-01972436-f8ba-4da7-bba0-c11d710df059 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.160688 May 25 14:55:31.043146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 79/154] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:30 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:31.118992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.127101 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.128612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.129713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0cc66055-a9f5-4c1d-a37d-0b10d179d244 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.155634 May 25 14:55:31.132112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 76/155] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:30 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:31.528046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:31.528654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:31.534757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:31.535207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.535992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:31.536427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.604310 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:31.606255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:31.616862 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:31.617657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.618659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:31.619305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.725660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.734468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6b4561d2-9142-45d2-b2be-80243d181445 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.210154 May 25 14:55:31.735413 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 80/156] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:31 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:31.773089 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:31.774043 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:31.780723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:31.781486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.784017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:31.784017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:31.800717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.803139 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:31.810336 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3240ae75-06ad-4595-80f6-5cf231ffc1a0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.215624 May 25 14:55:31.811086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 77/157] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:31 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:31.944616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:31.952220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-12d82783-df00-478a-bea5-1d3b52658552 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.182883 May 25 14:55:31.952792 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 81/158] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:31 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:32.059608 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:32.060221 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:32.067448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.067958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.068826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.069266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.149269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:32.149944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:32.160877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.161330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.162114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.162553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.296566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:32.305906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-67b6baab-ee27-4ce7-84f2-680e8b8bca5e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.250372 May 25 14:55:32.306573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 78/159] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:32 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:32.334007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:32.342488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:32.344216 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:32.345069 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ab68cbdf-1162-44d1-bca8-e5e1c7c126ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.201396 May 25 14:55:32.345612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 82/160] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:32 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:32.370733 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-fc1aed5a-c6f4-4049-8720-86a7678713aa req-303034a4-210f-45df-b504-a7e02efef45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150d8545-ce77-41fa-9c4c-1d157e865b6c", "name": "network-vif-plugged", "status": "completed", "tag": "47a43853-cc46-4066-8e17-9a8712025b8e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:32.378869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-fc1aed5a-c6f4-4049-8720-86a7678713aa req-303034a4-210f-45df-b504-a7e02efef45d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.379306 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-fc1aed5a-c6f4-4049-8720-86a7678713aa req-303034a4-210f-45df-b504-a7e02efef45d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.389764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-fc1aed5a-c6f4-4049-8720-86a7678713aa req-303034a4-210f-45df-b504-a7e02efef45d service nova] Creating event network-vif-plugged:47a43853-cc46-4066-8e17-9a8712025b8e for instance 150d8545-ce77-41fa-9c4c-1d157e865b6c on hv-cinder-83028 May 25 14:55:32.395587 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-fc1aed5a-c6f4-4049-8720-86a7678713aa req-303034a4-210f-45df-b504-a7e02efef45d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087626 May 25 14:55:32.396180 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 79/161] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:32.752126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:32.753282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:32.759575 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.760029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.760806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.761242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.829328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:32.830156 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:32.838233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.838712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.839479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.839914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.933873 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:32.942110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-826e8d87-1a16-4def-b6d4-a84f9378273d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.193840 May 25 14:55:32.949389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 83/162] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:32 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:32.969286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:32.969885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:32.978430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.979429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:32.980614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:32.981050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:33.078928 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:33.106658 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-444f78b8-1f85-4c42-a445-c13e4dc91d36 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.281535 May 25 14:55:33.107253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 80/163] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:32 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:33.190556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:33.198304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0a3f35da-381b-4b20-9d22-101832f9bcba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.233130 May 25 14:55:33.198918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 84/164] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:32 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:33.326020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:33.327448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:33.335070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:33.335530 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:33.336527 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:33.338253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:33.364201 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:33.365143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:33.372043 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:33.372682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:33.373648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:33.374184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:33.526249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:33.534920 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cc787e14-64db-4b06-8f55-3754afe8e1fc tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.213660 May 25 14:55:33.544254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 81/165] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:33 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:33.549948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:33.558014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:33.559571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:33.561562 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-522b996e-3296-41dc-a31d-fc0523243892 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.200905 May 25 14:55:33.561562 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 85/166] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:33 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:33.958987 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:33.959602 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:33.965569 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:33.966011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:33.966798 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:33.967229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.102175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.110069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-60b765ac-4a25-4748-8bb3-85ae56099b5f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.155417 May 25 14:55:34.110668 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 82/167] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:33 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:34.123733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:34.124377 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:34.132665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.133122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.133928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.134359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.217280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:34.217988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:34.224572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.225041 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.225823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.226255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.284811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.293284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-18c1a098-ba18-4a6d-b605-7a750546142b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.173252 May 25 14:55:34.293896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 86/168] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:34 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:34.515394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.523836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4e3cea5b-9878-4d7d-b7cf-eb6af9a89772 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.310528 May 25 14:55:34.524406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 83/169] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:34 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:34.553955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:34.554681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:34.561895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.562930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.563718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.564161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.587540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:34.590207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:34.601235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.601760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.602532 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:34.603088 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:34.786539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.794190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-21390599-4ad3-45ea-816b-7f6896fd83d0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.245840 May 25 14:55:34.796063 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 87/170] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:34 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:34.797859 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.806465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.808079 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:34.809170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-54aa8729-20fe-4c70-bd7e-69e6beec7e59 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.232377 May 25 14:55:34.809713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 84/171] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:34 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:35.126526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:35.127169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:35.133451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.133903 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.134950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.135159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.276426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:35.284797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5a40d5c1-300a-41bb-a269-0a8eaf5def25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.162032 May 25 14:55:35.285370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 88/172] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:35 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:35.310445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:35.311178 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:35.313534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:35.319724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.320177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.320969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.321468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.453787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:35.461825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a6a957b8-cca6-408d-92bd-e5fd40a0a6e3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.155361 May 25 14:55:35.462421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 85/173] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:35 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:35.540793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:35.541404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:35.547946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.548402 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.549182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.549652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.718965 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:35.726387 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9f2a3692-acdf-4bc6-b9c7-f153d291c64c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.189482 May 25 14:55:35.728708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 89/174] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:35 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:35.811916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:35.812507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:35.821175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.821570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.822523 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.823229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.828114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:35.828902 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:35.836742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.837698 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.843811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:35.843811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:35.862777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:36.044471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.053582 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b3317317-ce2a-4513-9e84-1fa4909f9d7c tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.245634 May 25 14:55:36.054558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 86/175] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:35 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:36.063399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-c74023bf-9c49-4ffe-9a76-066f5b0b9156 req-2381930e-bf7f-4fca-816a-415eab1f4a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed", "name": "network-vif-plugged", "status": "completed", "tag": "1adf867b-8b01-47c8-9071-efb5a796ac50"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:36.074972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.080558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.083924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.085006 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-00a8ae35-11cb-4524-bf48-54db465bbdcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.260793 May 25 14:55:36.085567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 90/176] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:35 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:36.089330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-c74023bf-9c49-4ffe-9a76-066f5b0b9156 req-2381930e-bf7f-4fca-816a-415eab1f4a1b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.089779 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-c74023bf-9c49-4ffe-9a76-066f5b0b9156 req-2381930e-bf7f-4fca-816a-415eab1f4a1b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.100837 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-c74023bf-9c49-4ffe-9a76-066f5b0b9156 req-2381930e-bf7f-4fca-816a-415eab1f4a1b service nova] Creating event network-vif-plugged:1adf867b-8b01-47c8-9071-efb5a796ac50 for instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed on hv-cinder-83028 May 25 14:55:36.105928 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-c74023bf-9c49-4ffe-9a76-066f5b0b9156 req-2381930e-bf7f-4fca-816a-415eab1f4a1b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050143 May 25 14:55:36.106730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 87/177] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:36.302423 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:36.303096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:36.310059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.310533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.311529 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.311962 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.468884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.479140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-35369d11-8144-43b6-b0f1-90360650549e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.181147 May 25 14:55:36.480143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 91/178] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:36 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:36.480741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:36.481929 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:36.488376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.488848 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.489648 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.490074 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.648025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.674925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1aaeb319-8d0e-4821-ae39-28dbd663ce5d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.188263 May 25 14:55:36.677990 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 88/179] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:36 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:36.743528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:36.744269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:36.750656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.751411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.752840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:36.753364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:36.887297 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:36.895005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-df9ce901-1274-4d9f-ae8a-eedfdc9876d0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.155377 May 25 14:55:36.895568 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 92/180] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:36 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:37.070310 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:37.071111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:37.077466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.077921 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.078717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.079163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.103212 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:37.103933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:37.115095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.117242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.118433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.121100 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.333532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:37.343616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:37.345108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:37.345513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:37.347444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8e217553-c9bd-4bfb-9704-c46927d2adef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.248299 May 25 14:55:37.348157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 93/181] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:37 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:37.364405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e100bb80-05df-4061-a207-06deade4db17 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.297829 May 25 14:55:37.365011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 89/182] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:37 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:37.680913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:37.680913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:37.680913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.680913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.682082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.682082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.682082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:37.682757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-996c2229-3d87-47f8-8af8-846972b1e70d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.148598 May 25 14:55:37.682757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 94/183] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:37 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:37.685054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:37.685669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:37.692216 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.692660 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.693460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.693886 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.837947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:37.845584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c614af06-0199-4396-8cbf-f937010aff12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.164797 May 25 14:55:37.847168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 90/184] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:37 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:37.914416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:37.915488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:37.922330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.922985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:37.923910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:37.924611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.323990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:38.333758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-52123e32-754a-4862-9b1f-055580e51bc8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.425605 May 25 14:55:38.338259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 95/185] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:37 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:38.366949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:38.367648 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:38.374326 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.375171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.376392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.377135 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.386326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:38.387196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:38.395777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.395777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.396533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.399656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.600743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:38.617529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:38.619095 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:38.620481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-22258388-be49-4c5c-8fbf-b647cf6756ce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.259132 May 25 14:55:38.621233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 91/186] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:38 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:38.626675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-6e5b373d-094b-47ce-8d7d-2fc1e48aa138 req-64f1fc2f-72bc-4b81-9d02-b18a58af97ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c1f5bd-4a13-4a35-9607-5bbff2d886e0", "name": "network-vif-plugged", "status": "completed", "tag": "e4ee92ba-bfd1-4a4a-94b6-1a50990a69b8"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:38.637647 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-6e5b373d-094b-47ce-8d7d-2fc1e48aa138 req-64f1fc2f-72bc-4b81-9d02-b18a58af97ce service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.638087 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-6e5b373d-094b-47ce-8d7d-2fc1e48aa138 req-64f1fc2f-72bc-4b81-9d02-b18a58af97ce service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.653377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-6e5b373d-094b-47ce-8d7d-2fc1e48aa138 req-64f1fc2f-72bc-4b81-9d02-b18a58af97ce service nova] Creating event network-vif-plugged:e4ee92ba-bfd1-4a4a-94b6-1a50990a69b8 for instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 on hv-cinder-83028 May 25 14:55:38.653582 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:38.662917 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-6e5b373d-094b-47ce-8d7d-2fc1e48aa138 req-64f1fc2f-72bc-4b81-9d02-b18a58af97ce service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039574 May 25 14:55:38.664212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 92/187] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:38.665825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-980c61da-a4ee-4b88-a6e6-d7812312ce90 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.283022 May 25 14:55:38.666623 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 96/188] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:38 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:38.677349 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:38.678053 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:38.684576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.685256 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.686046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.686490 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.829842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:38.833366 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0554e63c-daa9-4447-bb25-5149d9a9bd24 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.161082 May 25 14:55:38.833950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 93/189] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:38 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:38.877744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:38.878362 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:38.895528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.895998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:38.896779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:38.897219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.094810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:39.103439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e9580b84-203e-4332-a914-3a621b1023c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.238611 May 25 14:55:39.104009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 97/190] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:38 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:39.350305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:39.350971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:39.357063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.359140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.359140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.359140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.494811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:39.503951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3b3c7d64-bc36-4e2d-95ec-44e664f1809d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.157385 May 25 14:55:39.513899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 94/191] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:39 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:39.640386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:39.641034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:39.647340 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.647905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.648770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.649313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.683448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:39.684045 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:39.691242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.692386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.693424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.694067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.844998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:39.855179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:39.867360 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:39.868533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-022dc727-c40f-4709-96e7-e756ab75b164 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.232182 May 25 14:55:39.869101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 98/192] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:39 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:39.873555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:39.874169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:39.883530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.883987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.884775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:39.885220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:39.893194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:39.901614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a6628d85-954e-4e4a-b8b9-7532f4e84bbf tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.222036 May 25 14:55:39.914625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 95/193] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:39 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:40.079803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:40.087925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9647f817-2cb6-413f-bc80-774bdefa38ca tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.217821 May 25 14:55:40.088582 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 99/194] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:39 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:40.120495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:40.121130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:40.128689 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.129100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.130089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.130810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.150299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:40.291634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:40.299190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-281eb957-47f9-40ce-a12d-1a33f1e06d10 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.182519 May 25 14:55:40.299727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 96/195] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:40 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:40.520412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:40.521029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:40.531079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.531079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.542904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.543591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.691807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-906b285d-641c-4ac8-88f0-c30f12b5c15e req-a02ce5c0-fae4-4e2f-98ae-05e0aabef053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64837a10-d6e9-4fde-9766-7c03759eae0a", "name": "network-vif-plugged", "status": "completed", "tag": "17a70972-093e-43d6-a189-0a0186e2adeb"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:40.715155 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-906b285d-641c-4ac8-88f0-c30f12b5c15e req-a02ce5c0-fae4-4e2f-98ae-05e0aabef053 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.725386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-906b285d-641c-4ac8-88f0-c30f12b5c15e req-a02ce5c0-fae4-4e2f-98ae-05e0aabef053 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.770825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-906b285d-641c-4ac8-88f0-c30f12b5c15e req-a02ce5c0-fae4-4e2f-98ae-05e0aabef053 service nova] Creating event network-vif-plugged:17a70972-093e-43d6-a189-0a0186e2adeb for instance 64837a10-d6e9-4fde-9766-7c03759eae0a on hv-cinder-83028 May 25 14:55:40.782243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-906b285d-641c-4ac8-88f0-c30f12b5c15e req-a02ce5c0-fae4-4e2f-98ae-05e0aabef053 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106336 May 25 14:55:40.782895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 97/196] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:55:40.845110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:40.854591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e557da38-aa77-46e0-92d2-15a4af3ca2a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.338601 May 25 14:55:40.856453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 100/197] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:40 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:40.888887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:40.889798 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:40.905691 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.906320 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.907772 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.910097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.931245 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:40.932190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:40.948033 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.949469 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:40.950485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:40.951236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:41.492770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:41.500890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:41.503239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:41.504403 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f1bfdff0-b106-4b32-b018-9d10be8e6bef tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.621498 May 25 14:55:41.504972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 98/198] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:40 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:41.512012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:41.512614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:41.524238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:41.526141 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:41.526594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:41.527424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:41.527862 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:41.528054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-efe9453b-b746-4456-b031-de18c0daa7b0 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.604612 May 25 14:55:41.529146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 101/199] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:40 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:41.539601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:41.540800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:41.549475 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:41.550179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:41.551724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:41.552335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:41.740228 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:41.743273 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:41.759630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b410721b-d511-4074-98a2-d0f55eaa0f8d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.253549 May 25 14:55:41.759854 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-945e52c3-4954-422c-9fcb-6049354fe0bd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.224662 May 25 14:55:41.762333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 99/200] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:41 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:41.764966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 102/201] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:41 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:41.871940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:41.872550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:41.879636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:41.880085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:41.880863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:41.881299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.052605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:42.061680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e8554689-7daf-47da-9b75-cc2df7848d7f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.193557 May 25 14:55:42.065282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 100/202] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:41 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:42.523190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:42.523803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:42.529830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.530282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.531082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.531520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.544940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:42.545548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:42.552601 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.553047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.553991 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.554491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.740118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:42.742663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:42.748502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:42.750233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:42.750630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2b6b880a-7876-4b45-9180-adc8357d1542 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.209364 May 25 14:55:42.751328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 101/203] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:42 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:42.751510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-83f5001a-95b6-4330-991f-c5da83057f25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.232470 May 25 14:55:42.752767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 103/204] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:42 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:42.780599 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:42.783896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:42.799493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:42.800488 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.810904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:42.812225 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.815124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.817543 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.827029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.828056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:42.830883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:42.831685 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:43.042790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:43.044098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:43.052930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1e3701ff-50b2-4bfb-b6e7-bae0c45f3568 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.277180 May 25 14:55:43.055839 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 102/205] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:42 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:43.065440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5147b8fb-2537-4131-b57b-6b50429dcbd2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.279059 May 25 14:55:43.066292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 104/206] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:42 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:43.080375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:43.081198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:43.088242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:43.088659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:43.089544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:43.089976 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:43.225208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:43.233694 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-bf97b04a-79f5-4f22-afa2-6e71e74aab24 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.158295 May 25 14:55:43.234266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 103/207] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:43 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:43.772346 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:43.777723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:43.778342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:43.781697 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:43.790775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:43.790775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:43.790961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:43.791294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:43.796505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:43.796951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:43.797723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:43.798150 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.018985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.027792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.029841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8a3d39eb-d396-4520-bde5-51da70bb7d91 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.263627 May 25 14:55:44.029841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 105/208] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:43 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:44.037624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.039617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.040747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0f8ba249-9dda-4e79-a57e-5991e6b745e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.272874 May 25 14:55:44.041911 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 104/209] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:43 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:44.073397 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:44.074131 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:44.083565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.086822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:44.087442 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:44.090595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.091461 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.092084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.099785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.100239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.101015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.101453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.294492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.303299 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4c3c8b7d-9a51-4b2f-a649-9499d17fbc50 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.234943 May 25 14:55:44.307827 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 106/210] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:44 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:44.310883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.313679 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-ba8d8c9f-6d3d-4ef8-97c4-c03ced965fed req-e2608ccb-7d05-4d01-9183-20a8041bb270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d026df3e-764d-4346-8f57-3439f8239339", "name": "network-vif-plugged", "status": "completed", "tag": "ea7e1e22-9f9c-40eb-968a-be0fb1f82f9b"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:44.320510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-05815fab-1851-4a10-8d2f-bb963e9101ab tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.240137 May 25 14:55:44.321253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 105/211] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:44 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:44.331749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:44.332543 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:44.335077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ba8d8c9f-6d3d-4ef8-97c4-c03ced965fed req-e2608ccb-7d05-4d01-9183-20a8041bb270 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.335214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ba8d8c9f-6d3d-4ef8-97c4-c03ced965fed req-e2608ccb-7d05-4d01-9183-20a8041bb270 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.339332 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:44.339614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.340124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.340921 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:44.341514 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:44.367653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-ba8d8c9f-6d3d-4ef8-97c4-c03ced965fed req-e2608ccb-7d05-4d01-9183-20a8041bb270 service nova] Creating event network-vif-plugged:ea7e1e22-9f9c-40eb-968a-be0fb1f82f9b for instance d026df3e-764d-4346-8f57-3439f8239339 on hv-cinder-83028 May 25 14:55:44.369511 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-ba8d8c9f-6d3d-4ef8-97c4-c03ced965fed req-e2608ccb-7d05-4d01-9183-20a8041bb270 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060387 May 25 14:55:44.370110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 107/212] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:44.483598 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:44.491671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-59898cb7-6927-4875-8f49-30a019e9cf9e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.169281 May 25 14:55:44.492232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 106/213] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:44 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:45.046517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:45.047415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:45.055859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.056590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.057525 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.057973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.070763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:45.071974 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:45.085873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.086690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.088061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.088591 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.438314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.446150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.453594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ab00354d-c16a-4b30-a252-959004f0067b tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.411599 May 25 14:55:45.460118 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.461624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.462755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1c2e061f-b707-4968-aebe-0cd15dd494e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.405173 May 25 14:55:45.462992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 108/214] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:45 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:45.466909 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 107/215] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:45 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:45.468014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:45.468769 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:45.474512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:45.475300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:45.482821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.482821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.482821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.482821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.483124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.483124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.483567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.484004 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.710044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.718140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dd2a7c6d-7f38-42b3-953b-e523e864022a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.253872 May 25 14:55:45.718767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 109/216] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:45 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:45.723243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.731813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ae07f2d9-b0ef-4021-85c8-23203500e96a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.263881 May 25 14:55:45.732429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:45.732877 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 108/217] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:45 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:45.733104 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:45.739658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.740166 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.741233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:45.741977 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:45.918330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:45.932020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-575ee0bd-4025-4115-af55-0aee50fea868 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.202348 May 25 14:55:45.933080 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 110/218] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:45 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:46.470151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:46.471288 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:46.487332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.487841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.488141 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:46.489334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.489636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.490185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:46.499415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.501726 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.503090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.503863 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.758806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:46.765416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:46.773634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-681e526a-ffbc-4cf9-872c-4def4d042745 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1315 microversion: 2.1 time: 0.307191 May 25 14:55:46.782687 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:46.782876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 109/219] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:46 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:46.782970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:46.782970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bf04a742-10e2-4205-810f-ec89b7fabe25 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.295506 May 25 14:55:46.782970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 111/220] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:46 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:46.789167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:46.789167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:46.789167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.789167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.789938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.790534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.793236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:46.793855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:46.799868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.800449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.801220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:46.801650 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:46.991796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:47.010483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:47.010711 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-830ebef3-6f2f-40cb-8b5c-940d7f7e2c57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.232172 May 25 14:55:47.035046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 112/221] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:46 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:47.035046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:47.035046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:47.037482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:47.038241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:47.039012 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:47.039450 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:47.040468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-928c150f-1f97-4f49-a49c-5375db568089 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1361 microversion: 2.1 time: 0.265148 May 25 14:55:47.041225 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 110/222] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:46 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:47.224345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:47.232539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e82ba555-c05b-4573-a068-b1d732125203 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.207877 May 25 14:55:47.233112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 113/223] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:47 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:47.790507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:47.791155 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:47.795973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:47.796601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:47.802786 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:47.803238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:47.804300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:47.804747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:47.805611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:47.806224 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:47.807350 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:47.807949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.038041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.038165 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.038329 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.039905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.040709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-397e610e-c140-475a-9f5f-8509b8da09ce tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1502 microversion: 2.1 time: 0.254073 May 25 14:55:48.041017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e09096da-1526-4cde-9335-1dbf1bda4c8f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.249504 May 25 14:55:48.041293 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 111/224] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:47 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:48.046103 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:48.046734 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:48.053317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 114/225] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:47 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:48.058545 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:48.059161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:48.063424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.063976 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.065076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.065464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.066478 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.066947 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.067712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.068142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.287324 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.291885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.295021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1843e8c3-3637-47bf-bb0a-ff2a722d496e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1546 microversion: 2.1 time: 0.240458 May 25 14:55:48.295597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 115/226] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:48 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:48.300334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3c523b58-7982-4f6d-a268-294225cb441e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.257976 May 25 14:55:48.300485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:48.301061 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:48.301420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 112/227] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:48 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:48.309385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.309953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.310889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.315952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.319399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:48.319924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:48.325797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.326426 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.327355 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.328109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.499641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6e08cdec-5a57-4598-901e-1e1ae769d874 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188287 May 25 14:55:48.500366 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 113/228] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 14:55:48 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:48.506508 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-581ad1ff-c1f5-48dc-a79a-5a32457cff36 req-fcad64fe-60a6-4321-9ffd-c9ed62b18599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "name": "network-vif-plugged", "status": "completed", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:48.523507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-581ad1ff-c1f5-48dc-a79a-5a32457cff36 req-fcad64fe-60a6-4321-9ffd-c9ed62b18599 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:48.524276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-581ad1ff-c1f5-48dc-a79a-5a32457cff36 req-fcad64fe-60a6-4321-9ffd-c9ed62b18599 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:48.530628 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:48.540309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:48.543667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-581ad1ff-c1f5-48dc-a79a-5a32457cff36 req-fcad64fe-60a6-4321-9ffd-c9ed62b18599 service nova] Creating event network-vif-plugged:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 14:55:48.551372 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0a95a717-4b9c-430b-8ad8-1a3e179d422f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.253819 May 25 14:55:48.552203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 116/229] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:48 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:48.554699 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-581ad1ff-c1f5-48dc-a79a-5a32457cff36 req-fcad64fe-60a6-4321-9ffd-c9ed62b18599 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050323 May 25 14:55:48.560332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 114/230] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:49.073113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:49.076624 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:49.081807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:49.088152 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:49.088786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:49.089723 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:49.090471 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:49.280435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:49.288408 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:49.289937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:49.291149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-db3d9285-97d2-43e1-b8f3-027a179bb718 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.224272 May 25 14:55:49.291715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 117/231] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:49 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:49.323098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:49.323799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:49.336612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:49.337063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:49.337843 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:49.338278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:49.556069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:49.566233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b38a0cf3-5a02-48e3-b415-eed4ce2a8b3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.246994 May 25 14:55:49.569940 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:49.571037 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:49.576996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 115/232] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:49 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:49.579606 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:49.581002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:49.582008 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:49.582677 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:49.730442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:49.737899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-07badce0-082b-4eb7-a101-d8f9d1d1e26b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.172798 May 25 14:55:49.747177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 118/233] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:49 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:50.321088 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:50.322128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:50.340408 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.341646 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.342767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.343215 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.482500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:50.493972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:50.495533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:50.496850 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-387c2c86-7f18-4f64-a60a-f53a1d122a0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.191595 May 25 14:55:50.498377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 116/234] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:50 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:50.518931 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-56bdb532-86a3-4cdb-9915-cc7239497c5d req-251232b5-a01c-4e31-9c8b-b03f03504436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed", "tag": "1adf867b-8b01-47c8-9071-efb5a796ac50"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:50.527399 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-56bdb532-86a3-4cdb-9915-cc7239497c5d req-251232b5-a01c-4e31-9c8b-b03f03504436 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.527845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-56bdb532-86a3-4cdb-9915-cc7239497c5d req-251232b5-a01c-4e31-9c8b-b03f03504436 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.539418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-56bdb532-86a3-4cdb-9915-cc7239497c5d req-251232b5-a01c-4e31-9c8b-b03f03504436 service nova] Creating event network-changed:1adf867b-8b01-47c8-9071-efb5a796ac50 for instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed on hv-cinder-83028 May 25 14:55:50.554613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-56bdb532-86a3-4cdb-9915-cc7239497c5d req-251232b5-a01c-4e31-9c8b-b03f03504436 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032031 May 25 14:55:50.554613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 119/235] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:50.590463 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:50.591489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:50.599036 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.599469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.600242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.601872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.755965 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:50.758292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:50.776031 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.780638 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:50.784076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.795482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:50.796254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3d9c589d-f0eb-48a4-8f96-26c192780892 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1366 microversion: 2.1 time: 0.209388 May 25 14:55:50.799421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:50.805825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 117/236] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:50 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:51.029801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:51.040552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-822da98b-133a-4007-a066-fb521e4043eb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.287643 May 25 14:55:51.057120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9281e97b-0ea9-49d0-9f1b-e8f67d727373"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:51.058245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:51.061453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 120/237] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:50 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:51.065208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:51.065823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:51.066678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:51.067133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:51.517124 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:51.517979 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:51.525124 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:51.526065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:51.527966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:51.528521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:51.718009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:51.727744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:51.729426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:51.730607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-76b49e7e-a232-4390-9115-eedce84bc874 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.218377 May 25 14:55:51.743971 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 121/238] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:51 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:51.815376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:51.816257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:51.824748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:51.825200 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:51.827237 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:51.827856 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.015196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:52.029486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-65d71c73-cbf6-4d0a-afff-586a9f735b4e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1556 microversion: 2.1 time: 0.218078 May 25 14:55:52.030394 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 122/239] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:51 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1556 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:52.050879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:52.055492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:52.068367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:52.068933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.070119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:52.070565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.265702 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fdd536d7-fb35-4043-b05f-f5fc1cdf083e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218797 May 25 14:55:52.273247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 123/240] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 14:55:52 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:52.273247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:52.273247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:52.299867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:52.300367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.301186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:52.301615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.631348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:52.639127 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d12da90b-6690-4331-bbbf-9c97690250fb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1322 microversion: 2.1 time: 0.371574 May 25 14:55:52.639704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 124/241] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:52 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:52.749924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:52.750796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:52.757409 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:52.757770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.758837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:52.759270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:52.778430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:53.357317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:53.366805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:53.368972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:53.370493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c44b00d3-e8f0-4d74-a0c5-f659d1955f3d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.624796 May 25 14:55:53.371223 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 125/242] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:52 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:55:53.656717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:53.657262 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:53.664544 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:53.665077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:53.666061 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:53.667339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:53.983599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:53.993348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5b4a44a6-4aa7-4c43-897f-790f9b52080a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1517 microversion: 2.1 time: 0.341088 May 25 14:55:53.994035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 126/243] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:53 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:54.011732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:54.013152 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:54.021855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.022607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.023510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.024143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.050964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-765f4896-0037-4581-9046-b37a707c79ea tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "POST /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.997347 May 25 14:55:54.053015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 118/244] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 14:55:51 2022] POST /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c/os-volume_attachments => generated 194 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:55:54.078413 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lazy-loading 'flavor' on Instance uuid d026df3e-764d-4346-8f57-3439f8239339 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:55:54.396923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:54.397979 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:54.406575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.407061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.407833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.408807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.540153 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2329d0a7-2b64-46e0-a3a6-f8efd690b6bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339/action" status: 200 len: 32 microversion: 2.1 time: 0.532770 May 25 14:55:54.545321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 127/245] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 14:55:54 2022] POST /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339/action => generated 32 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 14:55:54.551694 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-5904da66-80c1-4070-a657-a74dd6a011dc req-1ff7df34-5fff-4cd2-bc10-e5e1712b9376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64837a10-d6e9-4fde-9766-7c03759eae0a", "tag": "17a70972-093e-43d6-a189-0a0186e2adeb"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:54.560100 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-5904da66-80c1-4070-a657-a74dd6a011dc req-1ff7df34-5fff-4cd2-bc10-e5e1712b9376 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.561814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-5904da66-80c1-4070-a657-a74dd6a011dc req-1ff7df34-5fff-4cd2-bc10-e5e1712b9376 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.572116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:54.578086 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-5904da66-80c1-4070-a657-a74dd6a011dc req-1ff7df34-5fff-4cd2-bc10-e5e1712b9376 service nova] Creating event network-changed:17a70972-093e-43d6-a189-0a0186e2adeb for instance 64837a10-d6e9-4fde-9766-7c03759eae0a on hv-cinder-83028 May 25 14:55:54.580541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:54.582058 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:54.583412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e0feae2a-63f7-4cac-92dd-303bb32888f0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1406 microversion: 2.20 time: 0.198213 May 25 14:55:54.583679 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-5904da66-80c1-4070-a657-a74dd6a011dc req-1ff7df34-5fff-4cd2-bc10-e5e1712b9376 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036772 May 25 14:55:54.583970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 119/246] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:54 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:54.584536 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 128/247] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:54.589975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:54.590676 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:54.597130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:54.597930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.598374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.599179 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:54.599614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:54.756506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:54.763509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cb108dbc-7966-4592-af13-4ecac2b3fbfb tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.177945 May 25 14:55:54.764185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 120/248] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:54 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:55.602973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:55.604486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:55.613496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:55.613956 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:55.614765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:55.615205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:55.780478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:55.781085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:55.788813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:55.789475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:55.790432 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:55.791040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:56.198008 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:56.206567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:56.208381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:56.210478 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-50e0829b-ca03-4ff0-a17b-7852fa6a1ae4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1598 microversion: 2.20 time: 0.611873 May 25 14:55:56.223410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 129/249] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:55:55 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1598 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:55:56.231454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:56.231832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:56.238354 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:56.238922 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:56.239715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:56.240324 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:56.306293 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:56.320197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2ad6fd66-9488-4b64-bfa4-813f4fe254d8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.543377 May 25 14:55:56.321229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 121/250] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:55 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:55:56.380438 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3e06d231-4338-49eb-afe9-5423d6fb50e4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153277 May 25 14:55:56.381114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 130/251] 10.222.0.74 () {60 vars in 1315 bytes} [Wed May 25 14:55:56 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:55:57.338947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:57.339564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:57.346124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:57.346583 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:57.347420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:57.347857 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:57.518012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:57.531647 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-62b17360-3ab3-4933-9b9f-c4b654609506 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.196351 May 25 14:55:57.534717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 122/252] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:57 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:57.832939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-90dd608c-80cb-47dc-9d26-71b692f7655b req-5463b9c7-b1ca-4e7b-bc8a-1505d737501a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:55:57.845300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-90dd608c-80cb-47dc-9d26-71b692f7655b req-5463b9c7-b1ca-4e7b-bc8a-1505d737501a service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:57.845950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-90dd608c-80cb-47dc-9d26-71b692f7655b req-5463b9c7-b1ca-4e7b-bc8a-1505d737501a service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:57.859471 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-90dd608c-80cb-47dc-9d26-71b692f7655b req-5463b9c7-b1ca-4e7b-bc8a-1505d737501a service nova] Creating event network-changed:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 14:55:57.867091 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-90dd608c-80cb-47dc-9d26-71b692f7655b req-5463b9c7-b1ca-4e7b-bc8a-1505d737501a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038729 May 25 14:55:57.868366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 131/253] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:55:58.556465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:58.557605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:58.564877 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:58.565813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:58.566949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:58.567542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:58.760925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:58.772610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-953f98fe-9f0f-443a-92b9-1ad35e2f7f38 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.220173 May 25 14:55:58.773427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 123/254] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:58 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:55:59.793024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:55:59.794046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:55:59.801071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:59.801512 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:59.802330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:55:59.802791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:55:59.972453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:55:59.980188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0b92cb97-218d-425d-b922-ffec3b0adeba tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.193655 May 25 14:55:59.980763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 132/255] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:55:59 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:00.997809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:00.998423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:01.005700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:01.006150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:01.007126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:01.007571 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:01.147450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:01.155450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9273d1aa-59ae-4f56-9afc-81834dfa5611 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.161467 May 25 14:56:01.155977 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 124/256] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:00 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:02.173248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:02.179066 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:02.180433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:02.181026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:02.181930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:02.182364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:02.316868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:02.324809 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e98435ad-51e3-460d-af50-3ffec28aa367 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.155587 May 25 14:56:02.333913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 133/257] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:02 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:03.341336 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:03.341942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:03.349110 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:03.349561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:03.350321 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:03.350776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:03.483740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:03.491391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e85952fb-4b0d-4f89-96f6-4f680d25fce8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.154050 May 25 14:56:03.491957 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 125/258] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:03 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:04.508314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:04.509163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:04.515411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:04.515856 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:04.516646 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:04.517079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:04.675812 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:04.683294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-57c0b803-8d17-4e7b-86b3-ada86a6987a3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.178912 May 25 14:56:04.684020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 134/259] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:04 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:05.702659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:05.703404 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:05.709771 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:05.710950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:05.712915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:05.713440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:05.913887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:05.922042 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-750b9516-1a74-4b89-957c-51c899a14794 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.223496 May 25 14:56:05.922723 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 126/260] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:05 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:06.946596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:06.947339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:06.953690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:06.954142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:06.955015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:06.955450 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:07.104519 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:07.112911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9dddfc66-65a3-4259-b62b-2e7d05fcadf0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.170319 May 25 14:56:07.113488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 135/261] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:06 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:08.130388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:08.131320 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:08.139158 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:08.139744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.140613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:08.141155 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.239555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:08.240044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:08.246059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:08.246507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.247339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:08.247770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.273597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 14:56:08.309640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:08.331788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a488c0d3-e317-4dfd-92c6-d0f8aba1e870 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.205916 May 25 14:56:08.333514 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 127/262] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:08 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:08.781186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0d0bce2a-1f99-4220-8928-738698910700 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "DELETE /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 204 len: 0 microversion: 2.1 time: 0.545021 May 25 14:56:08.794056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 136/263] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 14:56:08 2022] DELETE /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 14:56:08.802147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:08.802793 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:08.809247 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:08.809702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.810487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:08.810965 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:08.978307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:08.986547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5b37b23b-cd69-4cb4-8d7c-d86f37cd300e tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1554 microversion: 2.1 time: 0.188304 May 25 14:56:08.987157 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 128/264] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:08 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:09.358479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:09.359196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:09.365956 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:09.369264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:09.369264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:09.369264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:09.450234 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1107365077", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "networks": [{"uuid": "f9a624ff-fa61-40b5-9c94-194562a67bb2"}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:09.513302 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] validate_networks() for [('f9a624ff-fa61-40b5-9c94-194562a67bb2', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:09.611579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:09.619193 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0f3d8fa2-bc17-4b06-b370-63bc8467ec41 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.264932 May 25 14:56:09.620045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 137/265] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:09 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:09.940788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:09.941208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:09.941687 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:09.942093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:09.942502 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:09.951317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:09.951763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:09.952560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:09.952993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:09.969966 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Getting quotas for project f3fe34cb175740b299804b8c9d2f3371. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:09.974720 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Getting quotas for user 7792f354950d41a3b0b81267cd2714cc and project f3fe34cb175740b299804b8c9d2f3371. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:09.986541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:09.988828 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:10.005278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:10.005884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:10.013849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:10.016029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:10.016029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:10.016029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:10.139734 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f890a312-a364-4b34-9827-e65f6a9e42ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693491 May 25 14:56:10.145196 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 129/266] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:56:10.149972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c1137806-69dc-4da2-a2bd-73ba32fdbdf2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:10.150618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c1137806-69dc-4da2-a2bd-73ba32fdbdf2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:10.155294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:10.169540 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-37ad5bf7-e8a2-4810-b37e-6c2ed70a07c9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1554 microversion: 2.1 time: 0.167240 May 25 14:56:10.170704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 138/267] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:10 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:10.223446 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c1137806-69dc-4da2-a2bd-73ba32fdbdf2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:10.235076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c1137806-69dc-4da2-a2bd-73ba32fdbdf2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1214 microversion: 2.1 time: 0.088435 May 25 14:56:10.253817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 130/268] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:10 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:10.640483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:10.643582 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:10.651529 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:10.652081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:10.652958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:10.653496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:10.811148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:10.819446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8baf8bd2-86bf-4aa4-abcc-74e368c32df9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.183839 May 25 14:56:10.826018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 139/269] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:10 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:11.187725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:11.188601 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:11.196273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:11.196866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:11.197707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:11.198145 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:11.271103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4f9dad0e-ec1d-47cf-8ee0-99cadc4af562 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:11.271570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4f9dad0e-ec1d-47cf-8ee0-99cadc4af562 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:11.360182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4f9dad0e-ec1d-47cf-8ee0-99cadc4af562 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:11.368255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4f9dad0e-ec1d-47cf-8ee0-99cadc4af562 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1214 microversion: 2.1 time: 0.101295 May 25 14:56:11.369305 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 140/270] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:11 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:11.415083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:11.417476 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:11.424657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-02a01804-e2c0-4e70-ae8a-8f39b096fc3f tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1554 microversion: 2.1 time: 0.241001 May 25 14:56:11.425244 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 131/271] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:11 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:11.839357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:11.839895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:11.846217 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:11.847203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:11.848728 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:11.849179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:11.853172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:12.041341 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:12.050052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dc719a34-b847-4146-b9a7-135d379af0ef tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.214628 May 25 14:56:12.062836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 141/272] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:11 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:12.387092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:12.388147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:12.395931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:12.396373 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:12.397142 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:12.397641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:12.445772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:12.446783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:12.459043 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:12.459589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:12.461375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:12.462013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:12.500032 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:12.515063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8ba883e1-a62e-4c1f-bb2b-f2c9724902fb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1210 microversion: 2.1 time: 0.132363 May 25 14:56:12.516502 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 132/273] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:12 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:12.674304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:12.682967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-377b5425-9f0d-4373-84da-e34a4d8421aa tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1554 microversion: 2.1 time: 0.243545 May 25 14:56:12.684369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 142/274] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:12 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:12.878910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-401aa07d-5379-43da-94d3-b41c4f8909f5 req-bdfa9bdd-4d06-4d74-b6b9-b639685e67f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150d8545-ce77-41fa-9c4c-1d157e865b6c", "name": "network-vif-deleted", "tag": "47a43853-cc46-4066-8e17-9a8712025b8e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:12.888984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-401aa07d-5379-43da-94d3-b41c4f8909f5 req-bdfa9bdd-4d06-4d74-b6b9-b639685e67f6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:12.888984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-401aa07d-5379-43da-94d3-b41c4f8909f5 req-bdfa9bdd-4d06-4d74-b6b9-b639685e67f6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:12.901850 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-401aa07d-5379-43da-94d3-b41c4f8909f5 req-bdfa9bdd-4d06-4d74-b6b9-b639685e67f6 service nova] Creating event network-vif-deleted:47a43853-cc46-4066-8e17-9a8712025b8e for instance 150d8545-ce77-41fa-9c4c-1d157e865b6c on hv-cinder-83028 May 25 14:56:12.907554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-401aa07d-5379-43da-94d3-b41c4f8909f5 req-bdfa9bdd-4d06-4d74-b6b9-b639685e67f6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034014 May 25 14:56:12.908443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 133/275] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:13.070141 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:13.070774 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:13.080869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.081348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.082097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.082533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.277639 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:13.285141 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-174b7e88-f4f0-42ef-9a6c-156107c16c6a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.219758 May 25 14:56:13.286318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 143/276] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:13 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:13.539559 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:13.541653 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:13.552833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.554490 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.556154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.556881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.701755 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:13.702290 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:13.711911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.714968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.714968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:13.714968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:13.877616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:13.886170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d2c6b07b-6a13-4085-a48f-f7ce30c9d524 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1284 microversion: 2.1 time: 0.354592 May 25 14:56:13.889995 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 134/277] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:13 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:13.904796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a96ba1833514a7ba5f17409d0781026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1a1173d9a24de2b797fdf1c72f4131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:13.913428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-24f32c20-fcad-4486-a9a4-229280039186 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 200 len: 1346 microversion: 2.1 time: 0.215067 May 25 14:56:13.914037 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 144/278] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:13 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 1346 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:14.309741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:14.310468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:14.319208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.323740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.323740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.323740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.551992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:14.561890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-055a95bf-a738-4c63-bbb0-a6ecee8a7268 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.256206 May 25 14:56:14.562483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 135/279] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:14 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:14.910249 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:14.916327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:14.918256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.918965 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.919759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.920203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.943228 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:14.944959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:14.963153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.963995 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.965817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:14.966339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:14.983206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] HTTP exception thrown: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Request method failure captured: May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c HTTP/1.1 May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkMsQHUgrqqqUWTxQUnM7Pbq4goSrINSteF2nEBYJPr5P7XnfOpmEjRTin-irkg-7_UK1g-7Fpmahf9GUZ-hXIInbWOXbF7OUyu84kp23oF_rff4qFyl05pKJuhna26JUNP-1pGEwgXvBdgeSHGUFBbQybMJv6EBsU4aHa-zYqi21co May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 14:56:14.988469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}] May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-DeleteServersTestJSON-584183772 May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 8a96ba1833514a7ba5f17409d0781026 May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:14.990148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '150d8545-ce77-41fa-9c4c-1d157e865b6c'} May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:14.992955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:14.995124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:14.997128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Returning 404 to user: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:14.997128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-15424640-5b01-42a7-b201-5201d0e1b1a3 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 404 len: 111 microversion: 2.1 time: 0.055216 May 25 14:56:14.997128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 136/280] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:14 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:56:15.141749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:15.149104 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:15.152641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-57b9481c-e04f-4d26-9901-4015c791a664 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.246233 May 25 14:56:15.153748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 145/281] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:14 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:15.154102 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:15.176673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:15.177716 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:15.179600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:15.180556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:15.211841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] HTTP exception thrown: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Request method failure captured: May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c/os-volume_attachments HTTP/1.1 May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkMsQHUgrqqqUWTxQUnM7Pbq4goSrINSteF2nEBYJPr5P7XnfOpmEjRTin-irkg-7_UK1g-7Fpmahf9GUZ-hXIInbWOXbF7OUyu84kp23oF_rff4qFyl05pKJuhna26JUNP-1pGEwgXvBdgeSHGUFBbQybMJv6EBsU4aHa-zYqi21co May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 14:56:15.214023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}] May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-DeleteServersTestJSON-584183772 May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 8a96ba1833514a7ba5f17409d0781026 May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:15.215708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'server_id': '150d8545-ce77-41fa-9c4c-1d157e865b6c'} May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:15.216782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:15.219131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:15.222269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Returning 404 to user: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:15.222269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-229b32c0-edea-4bcc-b2d9-a7c1aff35ba9 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.078473 May 25 14:56:15.222269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 137/282] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 14:56:15 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 14:56:15.586282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:15.587333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:15.596396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:15.596920 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:15.597821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:15.598289 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:15.728869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-83153f3d-f328-4b40-bc28-eb3591132bd8 req-638e798d-3699-439b-bed8-ecd6af786b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1d6885-b053-42bd-8051-dadcbbc3706a", "tag": "cf532044-6836-4089-9a12-ce865ceb8d0d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:15.738083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-83153f3d-f328-4b40-bc28-eb3591132bd8 req-638e798d-3699-439b-bed8-ecd6af786b4c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:15.742987 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-83153f3d-f328-4b40-bc28-eb3591132bd8 req-638e798d-3699-439b-bed8-ecd6af786b4c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:15.750827 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-83153f3d-f328-4b40-bc28-eb3591132bd8 req-638e798d-3699-439b-bed8-ecd6af786b4c service nova] Creating event network-changed:cf532044-6836-4089-9a12-ce865ceb8d0d for instance ef1d6885-b053-42bd-8051-dadcbbc3706a on hv-cinder-83028 May 25 14:56:15.755752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-83153f3d-f328-4b40-bc28-eb3591132bd8 req-638e798d-3699-439b-bed8-ecd6af786b4c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 May 25 14:56:15.756341 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 138/283] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:15.804758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:15.812982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3d59d4ff-cb90-4091-a5cf-26e82d6ee623 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.234250 May 25 14:56:15.813572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 146/284] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:15 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:16.180738 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:16.181485 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:16.191202 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.192054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.193696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.194324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.371000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:16.378941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b5a6bf5e-2533-4a70-8e3d-103f7e7905f9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.202487 May 25 14:56:16.379526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 139/285] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:16 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:16.633805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:16.634661 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:16.641460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.641914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.642725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.643168 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.661099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] HTTP exception thrown: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Request method failure captured: May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c HTTP/1.1 May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkMsQHUgrqqqUWTxQUnM7Pbq4goSrINSteF2nEBYJPr5P7XnfOpmEjRTin-irkg-7_UK1g-7Fpmahf9GUZ-hXIInbWOXbF7OUyu84kp23oF_rff4qFyl05pKJuhna26JUNP-1pGEwgXvBdgeSHGUFBbQybMJv6EBsU4aHa-zYqi21co May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:56:16.666418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}] May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-DeleteServersTestJSON-584183772 May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 8a96ba1833514a7ba5f17409d0781026 May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.668832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '150d8545-ce77-41fa-9c4c-1d157e865b6c'} May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:16.670149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.672514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:16.674538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Returning 404 to user: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:16.674538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c6a8ebf3-e1a1-41a9-b0c4-19396491a6a2 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "DELETE /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 404 len: 111 microversion: 2.1 time: 0.039665 May 25 14:56:16.674538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 147/286] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 14:56:16 2022] DELETE /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:56:16.676533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:16.677207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] [instance: 150d8545-ce77-41fa-9c4c-1d157e865b6c] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:16.683517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.683908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.684732 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.685214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.699445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] HTTP exception thrown: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Request method failure captured: May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c HTTP/1.1 May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkMsQHUgrqqqUWTxQUnM7Pbq4goSrINSteF2nEBYJPr5P7XnfOpmEjRTin-irkg-7_UK1g-7Fpmahf9GUZ-hXIInbWOXbF7OUyu84kp23oF_rff4qFyl05pKJuhna26JUNP-1pGEwgXvBdgeSHGUFBbQybMJv6EBsU4aHa-zYqi21co May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 14:56:16.701133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/4a1a1173d9a24de2b797fdf1c72f4131"}]}] May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-DeleteServersTestJSON-584183772 May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 4a1a1173d9a24de2b797fdf1c72f4131 May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-DeleteServersTestJSON-584183772 May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 8a96ba1833514a7ba5f17409d0781026 May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-DeleteServersTestJSON-584183772-project May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.704663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '150d8545-ce77-41fa-9c4c-1d157e865b6c'} May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:16.706573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. May 25 14:56:16.710309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 14:56:16.716906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] Returning 404 to user: Instance 150d8545-ce77-41fa-9c4c-1d157e865b6c could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:16.716906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-afca6d1d-785c-451f-9790-ffe897474ee7 tempest-DeleteServersTestJSON-584183772 tempest-DeleteServersTestJSON-584183772-project] 10.222.0.74 "GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c" status: 404 len: 111 microversion: 2.1 time: 0.030068 May 25 14:56:16.716906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 140/287] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:16 2022] GET /compute/v2.1/servers/150d8545-ce77-41fa-9c4c-1d157e865b6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 14:56:16.833669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:16.834515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:16.841900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.842353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:16.843161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:16.843601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:17.001480 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:17.015666 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ff9842c7-66ab-4361-85a4-441c0e03e962 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.187572 May 25 14:56:17.019776 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 148/288] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:16 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:17.395725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:17.396333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:17.403040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:17.403492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:17.404267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:17.404798 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:17.587509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:17.607477 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a3bfc187-f7cc-4bdb-afb5-ecdbef364ee9 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.215245 May 25 14:56:17.609573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 141/289] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:17 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:18.035966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:18.037406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:18.045093 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:18.045523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:18.046489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:18.047129 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:18.206970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:18.215608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ebe6cc7c-e5f1-4a5f-b23a-0efc7e6e705a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.183400 May 25 14:56:18.216170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 149/290] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:18 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:18.631216 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:18.632868 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:18.642057 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:18.642862 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:18.644122 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:18.644846 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:18.812627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:18.826901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d02330dd-517e-4e67-b8b9-47bd76c59504 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.199852 May 25 14:56:18.827771 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 142/291] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:18 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:19.232494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:19.233263 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:19.239228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:19.239673 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:19.240449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:19.241511 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:19.402346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:19.413788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ffa53bc3-e8ee-4497-b568-bf4b0ac9bb89 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.184503 May 25 14:56:19.414460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 150/292] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:19 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:19.593048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b4b87859-38b2-4a59-89f7-ab282358603a tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Action: 'create', calling method: .version_select at 0x7f6fb4a22040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-325157583"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:19.848232 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:19.848787 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:19.855235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:19.859498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:19.859498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:19.859498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:19.961319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:19.998232 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:20.009426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d7e3acad-f5ba-4a61-99d3-4789bdc34be1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.164998 May 25 14:56:20.011032 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 151/293] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:19 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:20.232871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=8 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:20.267950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b4b87859-38b2-4a59-89f7-ab282358603a tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.791048 May 25 14:56:20.268788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 143/294] 10.222.0.74 () {60 vars in 1154 bytes} [Wed May 25 14:56:19 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 793 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 25 14:56:20.282468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c7dd9194-028e-4628-bf43-cafb3ab74f49 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48b38b0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:20.358615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c7dd9194-028e-4628-bf43-cafb3ab74f49 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 200 len: 344 microversion: 2.1 time: 0.081022 May 25 14:56:20.367568 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 152/295] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:20 2022] GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:20.431304 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:20.432112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:20.445160 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:20.445707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:20.446791 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:20.447277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:20.633617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:20.641528 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d708b97c-5086-4eec-b5f7-38845d1087e0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.215321 May 25 14:56:20.642106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 144/296] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:20 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:21.025754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:21.026449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:21.028294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:21.036023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:21.036515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:21.037451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:21.038532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:21.173358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:21.181731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-de3620eb-78f9-40d2-8862-2b27d98a0bc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.160358 May 25 14:56:21.182312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 153/297] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:21 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:21.372625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-437423fc-5fb3-4dce-ad36-673842b9bd12 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4a58550>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:21.427696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-437423fc-5fb3-4dce-ad36-673842b9bd12 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 200 len: 344 microversion: 2.1 time: 0.059016 May 25 14:56:21.428322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 145/298] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:21 2022] GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:21.658407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:21.659049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:21.660919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:21.665783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:21.666234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:21.667041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:21.667480 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:21.797417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:21.805488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cda881b3-90be-4520-be91-6f7edc666bd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.150887 May 25 14:56:21.806061 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 154/299] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:21 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:22.200413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:22.200936 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:22.207813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:22.208257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:22.209022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:22.209550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:22.347693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:22.355412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-882d90ff-1b1f-4766-b41d-8cb823febfcb tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.158921 May 25 14:56:22.355983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 146/300] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:22 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:22.440825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b6285572-e9f8-4bd1-81b6-3b5d1131c313 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48b3310>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:22.493968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b6285572-e9f8-4bd1-81b6-3b5d1131c313 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 200 len: 345 microversion: 2.1 time: 0.057314 May 25 14:56:22.494759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 155/301] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:22 2022] GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:22.505801 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-03de2fec-73fb-47d5-a189-eeca7124d4ea tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Action: 'create', calling method: .version_select at 0x7f6fb4a58af0>, body: {"snapshot": {"volume_id": "11349716-3140-4a08-8821-d472e3e4a0d8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1795583795"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:22.821960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:22.822575 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:22.828812 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:22.829256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:22.830026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:22.830458 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:22.989386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:22.997595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-71675ab0-4aea-4ec6-b676-97f01f79f012 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.179455 May 25 14:56:22.998170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 156/302] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:22 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:23.015832 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-03de2fec-73fb-47d5-a189-eeca7124d4ea tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.513799 May 25 14:56:23.016566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 147/303] 10.222.0.74 () {60 vars in 1161 bytes} [Wed May 25 14:56:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:23.031397 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1a2b3f14-cff7-4a77-8cd0-462a73b98bca tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48b3d30>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:23.062119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1a2b3f14-cff7-4a77-8cd0-462a73b98bca tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.035059 May 25 14:56:23.062738 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 157/304] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:23 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:23.078560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e2fe70b0-6e6d-4167-b80e-42f3991550ae tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4945160>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:23.125093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e2fe70b0-6e6d-4167-b80e-42f3991550ae tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054460 May 25 14:56:23.125776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 148/305] 10.222.0.74 () {58 vars in 1139 bytes} [Wed May 25 14:56:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:23.136117 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-70da64fe-6ddf-4e51-a337-c72293616b5b tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48b35e0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:23.169642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-70da64fe-6ddf-4e51-a337-c72293616b5b tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.037426 May 25 14:56:23.173971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-69ebe5fd-5eb9-4778-8751-3e437fe43e1e req-2ab1b30a-9140-446f-b52e-57deaab910f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1d6885-b053-42bd-8051-dadcbbc3706a", "name": "network-vif-plugged", "status": "completed", "tag": "cf532044-6836-4089-9a12-ce865ceb8d0d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:23.174974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 158/306] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:23 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:23.183483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-69ebe5fd-5eb9-4778-8751-3e437fe43e1e req-2ab1b30a-9140-446f-b52e-57deaab910f5 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:23.183930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-69ebe5fd-5eb9-4778-8751-3e437fe43e1e req-2ab1b30a-9140-446f-b52e-57deaab910f5 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:23.196386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-69ebe5fd-5eb9-4778-8751-3e437fe43e1e req-2ab1b30a-9140-446f-b52e-57deaab910f5 service nova] Creating event network-vif-plugged:cf532044-6836-4089-9a12-ce865ceb8d0d for instance ef1d6885-b053-42bd-8051-dadcbbc3706a on hv-cinder-83028 May 25 14:56:23.201467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-69ebe5fd-5eb9-4778-8751-3e437fe43e1e req-2ab1b30a-9140-446f-b52e-57deaab910f5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031467 May 25 14:56:23.202072 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 149/307] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:23.373152 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:23.373768 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:23.383183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:23.383648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:23.384479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:23.384911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:23.519728 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:23.527297 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c854c81e-710a-4495-998d-ff4536a20175 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.158082 May 25 14:56:23.527856 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 159/308] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:23 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:24.017285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:24.018098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:24.026354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:24.026950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:24.027851 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:24.028370 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:24.183005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5c411f9a-7f61-44c3-a671-0ae226dc5830 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb547c8b0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:24.214129 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5c411f9a-7f61-44c3-a671-0ae226dc5830 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.035061 May 25 14:56:24.228865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 160/309] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:24 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:24.399149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:24.410750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-18403036-e9f0-4ff1-943a-05bebd911a72 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.399381 May 25 14:56:24.411327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 150/310] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:24 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:24.544935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:24.545553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:24.551702 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:24.552175 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:24.553039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:24.553504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:24.690230 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:24.698422 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dcf656f1-10c1-4486-ac40-a7528d1b9183 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.157501 May 25 14:56:24.699032 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 161/311] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:24 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:25.227867 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-95b344f3-b5e9-4741-b5f7-12562f7d7dd2 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb49458b0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:25.257619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-95b344f3-b5e9-4741-b5f7-12562f7d7dd2 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.034252 May 25 14:56:25.258174 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 151/312] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:25 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:25.434839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:25.435441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:25.441795 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.442239 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.443024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.443454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.573936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:25.581613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-93462aea-3bfc-4cbf-ba11-1433b8800b3a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.150595 May 25 14:56:25.582191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 162/313] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:25 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:25.715645 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:25.716253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:25.722736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.723183 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.723958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:25.724388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:25.854942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:25.862296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1ab5ea6b-7b10-4404-95ce-232e2c287e10 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.150602 May 25 14:56:25.862923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 152/314] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:25 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:26.269529 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c47a40a4-cf35-414d-96b9-2175c04da4b7 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb496b1f0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:26.299047 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c47a40a4-cf35-414d-96b9-2175c04da4b7 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.033297 May 25 14:56:26.299616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 163/315] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:26 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:26.598670 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:26.600001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:26.602582 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:26.607334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:26.607776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:26.608555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:26.608985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:26.741741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:26.749170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c60c7991-784c-4cc6-a94f-80da0cbc5941 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.154297 May 25 14:56:26.749712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 153/316] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:26 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:26.878952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:26.879567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:26.886051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:26.886506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:26.887322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:26.887758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:26.902781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:27.020326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:27.027804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a161f559-d350-42af-b258-6d1a920c6f0f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.152788 May 25 14:56:27.028355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 164/317] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:26 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:27.310594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1d9fb8cc-6292-4c00-b6f4-dcaae28f3be2 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4a58280>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:27.342963 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1d9fb8cc-6292-4c00-b6f4-dcaae28f3be2 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.036057 May 25 14:56:27.343533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 154/318] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:27 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:27.765282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:27.765891 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:27.772574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:27.773028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:27.773797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:27.774234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:27.899472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:27.907383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-881a509c-1d26-493f-8f51-cfb4f6971fa7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.145936 May 25 14:56:27.908098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 165/319] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:27 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:28.045274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:28.045881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:28.051919 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.052369 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.053128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.053562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.185390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:28.193140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-572dbe07-66a7-420c-8cec-31a1bce50fc2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.152212 May 25 14:56:28.194181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 155/320] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:28 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:28.354494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4def63c9-9f9b-4be1-895f-d696456f0a0e tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb496b040>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:28.383000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4def63c9-9f9b-4be1-895f-d696456f0a0e tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.032247 May 25 14:56:28.383556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 166/321] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:28 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:28.925412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:28.926034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:28.932829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.933284 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:28.934151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:28.934593 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:29.071817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:29.079453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f783233c-af32-407f-bbb5-5ad11b6d21d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.158048 May 25 14:56:29.080077 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 156/322] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:28 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:29.211025 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:29.211566 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:29.217567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:29.218017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:29.218817 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:29.219254 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:29.354166 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:29.361735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ac02e400-6d0a-471a-b7b0-b1e2f3d896ce tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.155191 May 25 14:56:29.362268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 167/323] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:29 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:29.394794 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a407c545-8b70-4734-a3ce-a52ccc31bd11 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4b0d0d0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:29.423440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a407c545-8b70-4734-a3ce-a52ccc31bd11 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.032717 May 25 14:56:29.423999 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 157/324] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:29 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:30.095957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:30.096579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:30.102699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.103157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.103934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.104373 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.234454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:30.242486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-564edd86-718d-4196-9f55-fbca9db06d28 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.150346 May 25 14:56:30.244487 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 168/325] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:30 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:30.380322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:30.380932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:30.389066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.389519 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.390402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:30.391780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:30.435676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a3bd6113-282a-48fb-b779-0c0457b17fd4 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48bfca0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:30.465351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a3bd6113-282a-48fb-b779-0c0457b17fd4 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.033791 May 25 14:56:30.465912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 169/326] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:30 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:30.523958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:30.534531 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-54f5a5fc-f7bb-4a3f-880c-2d7e957f8a67 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.158802 May 25 14:56:30.535129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 158/327] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:30 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:31.259390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:31.259909 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:31.265836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:31.266282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:31.267067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:31.267502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:31.398907 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:31.407673 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-78f45be1-1b39-48f0-9e21-000e0ca361ff tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.152123 May 25 14:56:31.408527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 170/328] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:31 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:31.477447 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-22b69694-e7fc-4cf2-b435-33441645df7a tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4911b80>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:31.506295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-22b69694-e7fc-4cf2-b435-33441645df7a tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.033248 May 25 14:56:31.506901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 159/329] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:31 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:31.553104 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:31.553643 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:31.559833 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:31.560301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:31.561094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:31.561523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:31.690113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:31.697576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8f132d7c-68ca-4037-b1d1-05cec578be66 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.148955 May 25 14:56:31.698140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 171/330] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:31 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:32.425556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:32.426162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:32.432803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.433251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.434012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.434446 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.449529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:32.517235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f96f583a-fe5c-4375-898c-bda7cfe1edfe tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb496bdc0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:32.547934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f96f583a-fe5c-4375-898c-bda7cfe1edfe tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 288 microversion: 2.1 time: 0.034310 May 25 14:56:32.548600 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 172/331] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:32 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:32.559233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9a932758-19cc-47bf-86b2-4baaa71022f0 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb496b5e0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:32.575017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:32.584659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-babba82f-b197-4496-a4a5-677bf096b6c1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.159851 May 25 14:56:32.584659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 160/332] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:32 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:32.674790 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9a932758-19cc-47bf-86b2-4baaa71022f0 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "DELETE /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 202 len: 0 microversion: 2.1 time: 0.119099 May 25 14:56:32.675430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 173/333] 10.222.0.74 () {58 vars in 1253 bytes} [Wed May 25 14:56:32 2022] DELETE /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 14:56:32.683951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-39e2d2d3-c128-4cff-887e-a80dbfa345f0 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4a68d30>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:32.713206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-39e2d2d3-c128-4cff-887e-a80dbfa345f0 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 200 len: 287 microversion: 2.1 time: 0.032995 May 25 14:56:32.713760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 161/334] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:32 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:32.714275 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:32.714938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:32.721670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.722125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.722943 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:32.723385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:32.849608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:32.857902 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-921f9e09-7c67-4bed-8e7a-608e7bc92d74 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.147420 May 25 14:56:32.858463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 174/335] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:32 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:33.599286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.599896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:33.606149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.606599 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.607394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.607833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.725798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-17fbb7e2-4df5-4d43-ba66-ab063306f94f tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb496be50>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.735156 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:33.743360 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4c2c0fc7-ed2b-451f-9d59-724afe18cfd9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.148399 May 25 14:56:33.753009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 162/336] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:33 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-17fbb7e2-4df5-4d43-ba66-ab063306f94f tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] HTTP exception thrown: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-17fbb7e2-4df5-4d43-ba66-ab063306f94f tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Request method failure captured: May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 HTTP/1.1 May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkOT922RxPCOo3eV8QhVc8MDCITUyxfkvtiTzNGVlYJqe4CCRxXq1o5Nv24oWiMg4PnN5IrGie7bH-MadZYCzmCIBvplZCzxBRvb770T8Fu02EqNysdt-dPrjp_jqvFQxxGiHnjh8hurLHFlEj3sMpCgLhs6Sc6MAK8RfzZF4HXrEDE May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:56:33.753353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}] May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: b577a8a0aff647279759105fe2bc7a76 May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'fd8105ae-79a5-4259-8202-80c736277930'} May 25 14:56:33.754808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. (HTTP 404) (Request-ID: req-0dcd95c3-8eb6-4052-8dc8-2e2befe5548f) May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.755550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:33.756636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 25 14:56:33.757819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-17fbb7e2-4df5-4d43-ba66-ab063306f94f tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Returning 404 to user: Snapshot fd8105ae-79a5-4259-8202-80c736277930 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-17fbb7e2-4df5-4d43-ba66-ab063306f94f tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930" status: 404 len: 111 microversion: 2.1 time: 0.032564 May 25 14:56:33.759036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 175/337] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 14:56:33 2022] GET /compute/v2.1/os-snapshots/fd8105ae-79a5-4259-8202-80c736277930 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:56:33.762352 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5e518e29-df16-4ca3-b896-7c8761291e20 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48d0dc0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.874497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:33.875169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:33.882234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.885355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.885355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:33.885355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:33.997652 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5e518e29-df16-4ca3-b896-7c8761291e20 tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 202 len: 0 microversion: 2.1 time: 0.238475 May 25 14:56:33.998813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 163/338] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 14:56:33 2022] DELETE /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:56:34.006551 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1d24f2bc-139b-4c20-831f-c9ef77bb46ac tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb48e1160>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:34.030336 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:34.038551 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bc5b5e4a-78fb-466b-a165-5085d508ddb3 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1314 microversion: 2.1 time: 0.167822 May 25 14:56:34.039154 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 176/339] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:33 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:34.066184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1d24f2bc-139b-4c20-831f-c9ef77bb46ac tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 200 len: 344 microversion: 2.1 time: 0.063622 May 25 14:56:34.066784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 164/340] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:34 2022] GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:34.760628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:34.761299 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:34.767279 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:34.767743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:34.768500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:34.768946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:34.896479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:34.904486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-59c4d8c7-7a25-472a-be41-61266a52ce87 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.147837 May 25 14:56:34.905051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 177/341] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:34 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:35.057558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:35.058205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:35.067025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.067483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.068262 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.068706 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.079078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3fbb3245-7fd1-4b19-bb8b-8cd77d789d8c tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb49721f0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:35.106170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-3fbb3245-7fd1-4b19-bb8b-8cd77d789d8c tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] HTTP exception thrown: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3fbb3245-7fd1-4b19-bb8b-8cd77d789d8c tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Request method failure captured: May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 HTTP/1.1 May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkOT922RxPCOo3eV8QhVc8MDCITUyxfkvtiTzNGVlYJqe4CCRxXq1o5Nv24oWiMg4PnN5IrGie7bH-MadZYCzmCIBvplZCzxBRvb770T8Fu02EqNysdt-dPrjp_jqvFQxxGiHnjh8hurLHFlEj3sMpCgLhs6Sc6MAK8RfzZF4HXrEDE May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:56:35.108120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}] May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: b577a8a0aff647279759105fe2bc7a76 May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '11349716-3140-4a08-8821-d472e3e4a0d8'} May 25 14:56:35.109557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. (HTTP 404) (Request-ID: req-2abeb1c9-c598-4184-80ea-2233d7a666ce) May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.110342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:35.111464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:56:35.112722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3fbb3245-7fd1-4b19-bb8b-8cd77d789d8c tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Returning 404 to user: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3fbb3245-7fd1-4b19-bb8b-8cd77d789d8c tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 404 len: 109 microversion: 2.1 time: 0.034535 May 25 14:56:35.113949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 178/342] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:35 2022] GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 14:56:35.121045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ca688718-03f6-4197-8f4b-d390d56e543d tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4972700>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:35.149250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-ca688718-03f6-4197-8f4b-d390d56e543d tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] HTTP exception thrown: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ca688718-03f6-4197-8f4b-d390d56e543d tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Request method failure captured: May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 HTTP/1.1 May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkOT922RxPCOo3eV8QhVc8MDCITUyxfkvtiTzNGVlYJqe4CCRxXq1o5Nv24oWiMg4PnN5IrGie7bH-MadZYCzmCIBvplZCzxBRvb770T8Fu02EqNysdt-dPrjp_jqvFQxxGiHnjh8hurLHFlEj3sMpCgLhs6Sc6MAK8RfzZF4HXrEDE May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:56:35.151444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}] May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: b577a8a0aff647279759105fe2bc7a76 May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '11349716-3140-4a08-8821-d472e3e4a0d8'} May 25 14:56:35.152820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. (HTTP 404) (Request-ID: req-9420531d-0a12-4017-8147-c336607f6cc4) May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.153616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 14:56:35.154911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 14:56:35.156192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ca688718-03f6-4197-8f4b-d390d56e543d tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Returning 404 to user: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ca688718-03f6-4197-8f4b-d390d56e543d tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 404 len: 109 microversion: 2.1 time: 0.035499 May 25 14:56:35.157535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 179/343] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 14:56:35 2022] DELETE /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 14:56:35.161442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f14db185-9478-4cb7-a813-3358e6176acd tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Calling method '.version_select at 0x7f6fb4972310>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:35.189550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-f14db185-9478-4cb7-a813-3358e6176acd tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] HTTP exception thrown: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f14db185-9478-4cb7-a813-3358e6176acd tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Request method failure captured: May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 HTTP/1.1 May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkOT922RxPCOo3eV8QhVc8MDCITUyxfkvtiTzNGVlYJqe4CCRxXq1o5Nv24oWiMg4PnN5IrGie7bH-MadZYCzmCIBvplZCzxBRvb770T8Fu02EqNysdt-dPrjp_jqvFQxxGiHnjh8hurLHFlEj3sMpCgLhs6Sc6MAK8RfzZF4HXrEDE May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:56:35.191777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8aa6307af11843eeaf62ed59ae877463"}]}] May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 8aa6307af11843eeaf62ed59ae877463 May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163672524 May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: b577a8a0aff647279759105fe2bc7a76 May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163672524-project May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '11349716-3140-4a08-8821-d472e3e4a0d8'} May 25 14:56:35.193176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. (HTTP 404) (Request-ID: req-35fb77b0-2a02-45ae-9c4e-e845e3b15254) May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.194609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 14:56:35.195847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 14:56:35.197119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. May 25 14:56:35.198389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:35.199708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f14db185-9478-4cb7-a813-3358e6176acd tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] Returning 404 to user: Volume 11349716-3140-4a08-8821-d472e3e4a0d8 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:35.200546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f14db185-9478-4cb7-a813-3358e6176acd tempest-VolumesSnapshotsTestJSON-163672524 tempest-VolumesSnapshotsTestJSON-163672524-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8" status: 404 len: 109 microversion: 2.1 time: 0.042769 May 25 14:56:35.201105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 180/344] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:35 2022] GET /compute/v2.1/os-volumes/11349716-3140-4a08-8821-d472e3e4a0d8 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 14:56:35.205871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:35.213357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f4412293-136c-403a-a1e2-94e1ee6a30a2 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1499 microversion: 2.1 time: 0.160678 May 25 14:56:35.213920 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 165/345] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:35 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:35.920537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:35.921146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:35.927403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.928391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:35.929399 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:35.929837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:36.070096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:36.077808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f14cb357-9405-4431-894a-615b16559b78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.161707 May 25 14:56:36.078380 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 181/346] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:35 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:37.095215 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:37.095822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:37.103011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.103466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.104805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.105239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.176319 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:37.176811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:37.183505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.188231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.188231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.188231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.210530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 14:56:37.252060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:37.259518 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2ebd341b-be97-4e0f-84dc-aace42567220 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.168283 May 25 14:56:37.260086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 166/347] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:37 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:37.482400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1dabedcd-f047-4015-9008-f2ec37dc906b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "DELETE /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 204 len: 0 microversion: 2.1 time: 0.309536 May 25 14:56:37.486621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 182/348] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 14:56:37 2022] DELETE /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 14:56:37.491388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:37.492033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:37.498428 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.498916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.499687 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:37.500170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:37.633910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:37.641839 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a0fbada6-33e9-44d8-8336-71185e0d4672 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1505 microversion: 2.1 time: 0.154289 May 25 14:56:37.642462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 167/349] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:37 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:38.276159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:38.276848 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:38.282880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:38.283325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:38.284082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:38.284520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:38.412836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:38.420406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-becd3942-23ab-4269-81d3-381f4351f9bf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.148462 May 25 14:56:38.420958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 183/350] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:38 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:38.659077 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:38.659610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:38.666555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:38.667037 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:38.667817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:38.668250 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:38.798911 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:38.807162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-521ba64d-1454-40af-8084-fd1867c82c7d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1505 microversion: 2.1 time: 0.151932 May 25 14:56:38.807759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 168/351] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:38 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:39.437235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:39.437871 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:39.444709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.445163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.445929 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.446366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.572639 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:39.580057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-91acdb37-dc6f-4603-acb0-28efad535214 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.146705 May 25 14:56:39.580621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 184/352] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:39 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:39.824220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:39.824860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:39.831624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.832064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.832821 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:39.833250 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:39.966597 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:39.974071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ed57b214-cf89-4c4e-b4f7-86254b216bf6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1505 microversion: 2.1 time: 0.153778 May 25 14:56:39.974611 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 169/353] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:39 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:40.260784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4702786b-27b1-4f0b-ab54-af6301a08862 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb49729d0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:40.309879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4702786b-27b1-4f0b-ab54-af6301a08862 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/8445628c-b4a7-4e8e-9227-546f4a5fda45" status: 200 len: 351 microversion: 2.1 time: 0.052596 May 25 14:56:40.311367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 185/354] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:40 2022] GET /compute/v2.1/os-volumes/8445628c-b4a7-4e8e-9227-546f4a5fda45 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:40.597030 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:40.597662 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:40.604384 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.604831 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.605589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:40.606027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:40.732488 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:40.739895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e7f082c5-88b9-4037-ba0f-093cda208943 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.146733 May 25 14:56:40.740481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 170/355] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:40 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:40.991800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:40.992337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:40.998368 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.002062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.002062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.002062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.126384 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:41.134370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-02f4d91c-c63b-45f3-8514-7ca224ffa25f tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1505 microversion: 2.1 time: 0.146596 May 25 14:56:41.134980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 186/356] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:40 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:41.757254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:41.757863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:41.764361 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.764811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.765573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:41.766009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:41.891787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:41.900048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-28c377d4-b5fe-4c6c-8fc1-57ad2d1a73c9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.147230 May 25 14:56:41.900619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 171/357] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:41 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:42.152298 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:42.152840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:42.158892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.159384 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.160133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.160564 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.290202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:42.297710 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cacbf547-a8ef-4bcd-a27e-374cf8b568ed tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1505 microversion: 2.1 time: 0.149296 May 25 14:56:42.298280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 187/358] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:42 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:42.917323 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:42.917930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:42.924402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.924853 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.925620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:42.926058 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:42.986754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2c06a657-c466-4e1d-984f-19a3105ffd58 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb4861430>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:43.043747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2c06a657-c466-4e1d-984f-19a3105ffd58 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/5aebc119-ef1f-4987-baef-dd6a88fb2fb8" status: 200 len: 351 microversion: 2.1 time: 0.060885 May 25 14:56:43.044322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 188/359] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:42 2022] GET /compute/v2.1/os-volumes/5aebc119-ef1f-4987-baef-dd6a88fb2fb8 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:43.072253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:43.079778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2287ad09-91f8-4030-afc9-e8783903c0f3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.166372 May 25 14:56:43.092288 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 172/360] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:42 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:43.315482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:43.316144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:43.323427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.323879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.325406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.325764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.348753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:43.523569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:43.533162 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f4f3764c-604b-4103-9c5d-270fd53ae639 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1505 microversion: 2.1 time: 0.221802 May 25 14:56:43.533885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 189/361] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:43 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:43.974322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-07e9141a-d825-459d-98b5-1cd15860b53c req-ed714bb2-7106-44cf-a07e-05a31a1d3574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1d6885-b053-42bd-8051-dadcbbc3706a", "name": "network-vif-deleted", "tag": "cf532044-6836-4089-9a12-ce865ceb8d0d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:43.983124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-07e9141a-d825-459d-98b5-1cd15860b53c req-ed714bb2-7106-44cf-a07e-05a31a1d3574 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:43.983564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-07e9141a-d825-459d-98b5-1cd15860b53c req-ed714bb2-7106-44cf-a07e-05a31a1d3574 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:43.994049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-07e9141a-d825-459d-98b5-1cd15860b53c req-ed714bb2-7106-44cf-a07e-05a31a1d3574 service nova] Creating event network-vif-deleted:cf532044-6836-4089-9a12-ce865ceb8d0d for instance ef1d6885-b053-42bd-8051-dadcbbc3706a on hv-cinder-83028 May 25 14:56:43.998998 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-07e9141a-d825-459d-98b5-1cd15860b53c req-ed714bb2-7106-44cf-a07e-05a31a1d3574 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028350 May 25 14:56:43.999664 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 173/362] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:44.107364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:44.107968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:44.114828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.115358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.116116 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.116574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.245752 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:44.253977 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-498f6cfa-291c-4033-9912-41231229e4ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1523 microversion: 2.1 time: 0.150654 May 25 14:56:44.254546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 190/363] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:44 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:44.550539 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:44.551449 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:44.558340 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.564207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.564207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:44.564207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:44.627831 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:44.635914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-89ac3d58-90b3-46a4-8d34-620fd18d2b1d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 200 len: 1299 microversion: 2.1 time: 0.089920 May 25 14:56:44.636479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 174/364] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:44 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:45.271170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:45.272226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:45.278210 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.278668 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.279436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.279867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.407403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:45.415793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ab5fe658-b044-42b8-98d5-c1df5ef369b8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1503 microversion: 2.1 time: 0.148541 May 25 14:56:45.416546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 191/365] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:45 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:45.432295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:45.433761 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:45.441287 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.441741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.442540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.443043 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.604604 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:45.615022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2bf02760-0ec6-49f2-b8ce-eec5f250ed3b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1516 microversion: 2.1 time: 0.187189 May 25 14:56:45.618793 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 175/366] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:45 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:45.653436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:45.654053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: ef1d6885-b053-42bd-8051-dadcbbc3706a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:45.660248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.660762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.661796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:45.662274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:45.677033 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] HTTP exception thrown: Instance ef1d6885-b053-42bd-8051-dadcbbc3706a could not be found. May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Request method failure captured: May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a HTTP/1.1 May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkOGU679kOMgyZ3Bzx1oNeAHKzUt19mDRp-VYx_vvofgdnPBFY5CgjIfzr6SOVgHs1r9hYefSJhjmj4wOxZUl_jPy1cygqeAjW5twTineThFVn_xuNyvi5_UDeUT1n1v1yrvVj6uQ4c9YeFUyv_2fl8I2MAayjUo_PTNnGbT3dB8k9U May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: f3fe34cb175740b299804b8c9d2f3371 May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesActionsTest-1430424166 May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:56:45.679318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f3fe34cb175740b299804b8c9d2f3371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f3fe34cb175740b299804b8c9d2f3371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f3fe34cb175740b299804b8c9d2f3371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f3fe34cb175740b299804b8c9d2f3371"}]}] May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesActionsTest-1430424166 May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: f3fe34cb175740b299804b8c9d2f3371 May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesActionsTest-1430424166 May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesActionsTest-1430424166-project May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 7792f354950d41a3b0b81267cd2714cc May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesActionsTest-1430424166-project May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance ef1d6885-b053-42bd-8051-dadcbbc3706a could not be found. May 25 14:56:45.680689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'ef1d6885-b053-42bd-8051-dadcbbc3706a'} May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1d6885-b053-42bd-8051-dadcbbc3706a could not be found. May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:56:45.681451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1d6885-b053-42bd-8051-dadcbbc3706a could not be found. May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1d6885-b053-42bd-8051-dadcbbc3706a could not be found. May 25 14:56:45.682688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:56:45.683742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Returning 404 to user: Instance ef1d6885-b053-42bd-8051-dadcbbc3706a could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:56:45.683742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5353c750-82bb-4577-98e4-b011d52eb36b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a" status: 404 len: 111 microversion: 2.1 time: 0.031753 May 25 14:56:45.683742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 192/367] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:45 2022] GET /compute/v2.1/servers/ef1d6885-b053-42bd-8051-dadcbbc3706a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:56:45.783394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1913197911", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "networks": [{"uuid": "f9a624ff-fa61-40b5-9c94-194562a67bb2"}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:45.834709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] validate_networks() for [('f9a624ff-fa61-40b5-9c94-194562a67bb2', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:56:46.176083 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3453832f-ea80-4704-a389-f0af5b9f8243 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb48611f0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.183726 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:56:46.186682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:56:46.186682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:56:46.186682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:56:46.186682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:56:46.196440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.197028 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.197834 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:46.198383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:46.216985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Getting quotas for project f3fe34cb175740b299804b8c9d2f3371. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:56:46.237056 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Getting quotas for user 7792f354950d41a3b0b81267cd2714cc and project f3fe34cb175740b299804b8c9d2f3371. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:56:46.237056 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:56:46.237056 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:56:46.285014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3453832f-ea80-4704-a389-f0af5b9f8243 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/b21885a4-42b1-49b7-a334-85a1699e7f85" status: 200 len: 350 microversion: 2.1 time: 0.112738 May 25 14:56:46.285805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 193/368] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes/b21885a4-42b1-49b7-a334-85a1699e7f85 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:46.299332 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-55f8107b-af1c-47ed-97c4-3815627c7b0b tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb4972310>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.380719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-55f8107b-af1c-47ed-97c4-3815627c7b0b tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086547 May 25 14:56:46.381286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 194/369] 10.222.0.74 () {58 vars in 1133 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:46.395606 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a3154d32-e4ce-4ac6-bd6b-794ae65b39b7 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615975 May 25 14:56:46.401681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 176/370] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 14:56:46.401944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ea2d2441-59bf-4fb2-8a1a-880ae3ffb497 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb4972160>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.407035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3cdf2975-5bc3-4b74-add4-0f28fa0d36fc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.407546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3cdf2975-5bc3-4b74-add4-0f28fa0d36fc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:46.501203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ea2d2441-59bf-4fb2-8a1a-880ae3ffb497 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110038 May 25 14:56:46.502244 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3cdf2975-5bc3-4b74-add4-0f28fa0d36fc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:46.506686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 195/371] 10.222.0.74 () {58 vars in 1148 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:56:46.511277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3cdf2975-5bc3-4b74-add4-0f28fa0d36fc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1214 microversion: 2.1 time: 0.108281 May 25 14:56:46.511813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 177/372] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:46.517022 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5be2cc2a-7ae4-4ab1-8b56-29ab543d1e3b tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb53cf040>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.602050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5be2cc2a-7ae4-4ab1-8b56-29ab543d1e3b tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088841 May 25 14:56:46.602610 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 196/373] 10.222.0.74 () {58 vars in 1133 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:46.613781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0761feac-9ac0-4331-8d72-ed113a6b31f9 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb48e1310>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.695426 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0761feac-9ac0-4331-8d72-ed113a6b31f9 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085364 May 25 14:56:46.696000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 178/374] 10.222.0.74 () {58 vars in 1166 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:46.707700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e2b3a813-2c53-4184-acfa-09f5f8b94fea tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb4972940>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.788682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e2b3a813-2c53-4184-acfa-09f5f8b94fea tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084680 May 25 14:56:46.789417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 197/375] 10.222.0.74 () {58 vars in 1169 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:46.801123 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-260124bd-6fed-4c96-bbad-5929e50fe124 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb48d0dc0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.880927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-260124bd-6fed-4c96-bbad-5929e50fe124 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083451 May 25 14:56:46.881523 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 179/376] 10.222.0.74 () {58 vars in 1154 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:46.892827 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0c4c445c-11ba-4954-bb3e-80fe7b00ba95 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb4861040>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:46.973697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0c4c445c-11ba-4954-bb3e-80fe7b00ba95 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084535 May 25 14:56:46.978281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 198/377] 10.222.0.74 () {58 vars in 1187 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:46.986294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1abeb27d-d21d-40f4-8e4d-356ac3760ae0 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] Calling method '.version_select at 0x7f6fb48fa820>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:47.070923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1abeb27d-d21d-40f4-8e4d-356ac3760ae0 tempest-VolumesTestJSON-1866495287 tempest-VolumesTestJSON-1866495287-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088258 May 25 14:56:47.071492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 180/378] 10.222.0.74 () {58 vars in 1154 bytes} [Wed May 25 14:56:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:47.528342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:47.529005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:47.535237 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.535678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.536432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:47.536863 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:47.597014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:47.604356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4b89623c-686c-4397-a485-f7bdb6f1ea31 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1218 microversion: 2.1 time: 0.079985 May 25 14:56:47.604925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 199/379] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:47 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:48.621713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:48.622254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:48.628326 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.628780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.629546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:48.629984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:48.689000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:48.697142 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-df611495-8799-4dc9-acd8-34ed561cfa3e tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1210 microversion: 2.1 time: 0.079956 May 25 14:56:48.697702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 181/380] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:48 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:49.713932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:49.714489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:49.720565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:49.721007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.721761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:49.722191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:49.779881 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:49.787672 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-865e4127-ff8d-47cd-90f0-46722f2b4ae1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1210 microversion: 2.1 time: 0.077059 May 25 14:56:49.788228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 200/381] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:49 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1210 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:50.804934 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:50.805543 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:50.812082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.812536 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.813300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:50.813736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:50.875252 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:50.882580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-05744bb8-0c21-4f92-bcdc-53b8ae51c111 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1210 microversion: 2.1 time: 0.082107 May 25 14:56:50.883175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 182/382] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:50 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:51.899462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:51.900076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:51.902220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:51.907090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:51.907532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:51.908298 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:51.908731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:51.968729 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:51.976429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-845a03a2-27d4-49f6-a90e-b01b31eefdc0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1266 microversion: 2.1 time: 0.081026 May 25 14:56:51.976987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 201/383] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:51 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:52.993289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:52.993957 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:53.000163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.000622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.001392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:53.001820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:53.135590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:53.143085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-dac87a2e-c6aa-4ea7-a387-7b1a5b02de38 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.153763 May 25 14:56:53.143643 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 183/384] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:52 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:54.023208 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-5c66d3b1-8422-4b36-bc79-9052ac0a857c req-fcea2792-169a-4c4f-b1ce-0e7869367778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1228e9-2eea-49b9-a684-e2d94a8a103f", "tag": "e7c11888-837a-4003-86b7-15a681a1d925"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:54.031617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-5c66d3b1-8422-4b36-bc79-9052ac0a857c req-fcea2792-169a-4c4f-b1ce-0e7869367778 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.032053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-5c66d3b1-8422-4b36-bc79-9052ac0a857c req-fcea2792-169a-4c4f-b1ce-0e7869367778 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.049636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-5c66d3b1-8422-4b36-bc79-9052ac0a857c req-fcea2792-169a-4c4f-b1ce-0e7869367778 service nova] Creating event network-changed:e7c11888-837a-4003-86b7-15a681a1d925 for instance de1228e9-2eea-49b9-a684-e2d94a8a103f on hv-cinder-83028 May 25 14:56:54.054887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-5c66d3b1-8422-4b36-bc79-9052ac0a857c req-fcea2792-169a-4c4f-b1ce-0e7869367778 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035557 May 25 14:56:54.055468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 202/385] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:56:54.166554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:54.167238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:54.174194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.174656 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.175444 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:54.175898 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:54.311775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:54.320062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2b298ce4-4a1c-4121-93f7-d4be5334dcf0 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.157485 May 25 14:56:54.320724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 184/386] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:54 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:56:55.337359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:55.338089 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:55.344329 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.344775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.345537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:55.345972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:55.471520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:55.479886 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fc5bb334-14fd-4ead-a9d8-824f2113f1ad tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.146754 May 25 14:56:55.480452 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 203/387] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:55 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:56.496259 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:56.496875 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:56.499364 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:56.504207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.504661 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.505471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.506413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.506950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=8 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:56.522667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:56.636280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:56.643750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5e1fd3fb-7193-4b21-826a-920cc3870de8 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.151496 May 25 14:56:56.644321 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 185/388] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:56 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:56.849120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:56:56.850119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:56.856176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.856620 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.864137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:56.864137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:56.887051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lazy-loading 'flavor' on Instance uuid 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:56:57.177629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ee901c3a-3420-4672-9c0e-f74753502263 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/action" status: 200 len: 32 microversion: 2.1 time: 0.332642 May 25 14:56:57.178276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 204/389] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 14:56:56 2022] POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 14:56:57.187386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:57.187989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:57.190131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:57.194917 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.195363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.196119 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.196549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.327466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:57.335718 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-35bc2656-c896-4a2a-b1a6-4b537bbb5559 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.152165 May 25 14:56:57.336281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 186/390] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:57 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:57.661797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:57.662526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:57.668775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.669222 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.669990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:57.670426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:57.795805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:57.803907 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-38c8c440-86de-4c9c-824b-728369f9b231 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.146332 May 25 14:56:57.812652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 205/391] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:57 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:58.353017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:58.353627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:58.360577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.361024 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.361787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.362225 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.495089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:58.502828 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-62cc3e93-047c-42f5-a4e2-78e2d9f744cd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.153760 May 25 14:56:58.503388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 187/392] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:58 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:58.820992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:58.821679 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:58.829192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.829642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.830410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:58.830880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:58.963335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:58.970766 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-71a52f15-8ab8-4222-a726-4b4f8bed6678 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.154223 May 25 14:56:58.971335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 206/393] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:58 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:59.520314 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:59.520914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:59.528938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.529389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.530159 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.530813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.672998 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:56:59.680712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5437ef97-6ab7-48d2-860e-13c4a5412e9a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.164495 May 25 14:56:59.681291 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 188/394] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:59 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:56:59.992456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:56:59.992456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:56:59.998130 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:56:59.998836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:56:59.999799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:00.000377 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:00.191395 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:00.198568 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8b3f2ba9-acc1-42d6-86d0-1700240548a4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.214981 May 25 14:57:00.199273 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 207/395] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:56:59 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:00.698387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:00.699026 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:00.705372 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:00.705815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:00.706575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:00.707035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:00.836445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:00.843984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7397731f-2aa3-467b-abcf-835db761a2f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.149536 May 25 14:57:00.844826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 189/396] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:00 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:01.215271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:01.215908 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:01.221841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.222287 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.223092 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.223526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.345606 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-c9195502-2313-4afb-92ed-52dec7140745 req-19ae8a5f-8246-4cf6-a5fd-8e2d3d1f07aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1228e9-2eea-49b9-a684-e2d94a8a103f", "name": "network-vif-plugged", "status": "completed", "tag": "e7c11888-837a-4003-86b7-15a681a1d925"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:01.354170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-c9195502-2313-4afb-92ed-52dec7140745 req-19ae8a5f-8246-4cf6-a5fd-8e2d3d1f07aa service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.354616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-c9195502-2313-4afb-92ed-52dec7140745 req-19ae8a5f-8246-4cf6-a5fd-8e2d3d1f07aa service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.358082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:01.365640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-c9195502-2313-4afb-92ed-52dec7140745 req-19ae8a5f-8246-4cf6-a5fd-8e2d3d1f07aa service nova] Creating event network-vif-plugged:e7c11888-837a-4003-86b7-15a681a1d925 for instance de1228e9-2eea-49b9-a684-e2d94a8a103f on hv-cinder-83028 May 25 14:57:01.366022 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5cd47bc3-f9eb-438c-bcb5-e4fbabbf9240 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.154586 May 25 14:57:01.366588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 208/397] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:01 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:01.377360 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-c9195502-2313-4afb-92ed-52dec7140745 req-19ae8a5f-8246-4cf6-a5fd-8e2d3d1f07aa service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036041 May 25 14:57:01.377935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 190/398] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 14:57:01.861300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:01.861920 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:01.868628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.869020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.869794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:01.870234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:01.995776 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:02.003705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c7f9d789-0601-4aa5-a678-34e0ff70c7ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.146348 May 25 14:57:02.004277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 209/399] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:01 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:02.383519 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:02.384150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:02.390500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:02.391084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:02.391852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:02.392287 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:02.524900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:02.532343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1cde4aa3-03e8-4dba-a0ef-29e7e431699b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.153540 May 25 14:57:02.532914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 191/400] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:02 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:03.019870 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:03.020488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:03.026629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:03.027103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:03.027878 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:03.028317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:03.166572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:03.174173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-86b1cad0-cd99-4eed-a1ef-d477375dfbc3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.158126 May 25 14:57:03.174878 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 210/401] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:03 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:03.550108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:03.550751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:03.557769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:03.558207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:03.558996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:03.559429 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:03.712716 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:03.720127 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ffc680b7-adf6-4a27-803f-e2dc059632fe tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.174023 May 25 14:57:03.720679 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 192/402] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:03 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:04.191921 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:04.192564 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:04.199155 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:04.199600 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:04.200364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:04.200795 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:04.216480 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:04.328841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:04.337188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-21490a2c-3a7e-403f-bfa8-99fde8629398 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.149355 May 25 14:57:04.337866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 211/403] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:04 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:04.737227 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:04.737840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:04.744996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:04.745450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:04.746270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:04.746877 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:04.881825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:04.889263 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a5a8eda5-0330-478c-8208-5eb70a979ad4 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.155965 May 25 14:57:04.889852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 193/404] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:04 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:05.356040 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:05.356748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:05.363222 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.363736 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.364576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.365070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.494093 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:05.501446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-813ab47b-269d-4f72-8747-408df7cf1b21 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.150159 May 25 14:57:05.502009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 212/405] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:05 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:05.906117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:05.906685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:05.913371 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.913821 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:05.914586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:05.915054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.045196 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:06.052850 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7f5f4cbd-efee-48c6-99f9-b628441e67ac tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.150773 May 25 14:57:06.053510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 194/406] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:05 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:06.518629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:06.519363 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:06.526213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:06.526728 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.527704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:06.528214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:06.656414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:06.663724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-85ace989-4b4f-4476-90a0-06f3a3b9209a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.149105 May 25 14:57:06.664280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 213/407] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:06 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:07.069817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:07.070420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:07.077030 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.077470 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.078222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.078667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.202481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:07.210073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1719ca9c-97d8-4458-a228-3c539e230fc1 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.144004 May 25 14:57:07.210665 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 195/408] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:07 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:07.680212 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:07.680897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:07.687159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.693504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.693504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:07.693504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:07.819864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:07.827824 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-74ac879b-7cc0-4196-96bd-1b454a5804b1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.151487 May 25 14:57:07.828383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 214/409] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:07 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:08.226895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:08.228132 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:08.234836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.235292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.236066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.236504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.366213 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:08.373586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b759dee3-8882-432b-a9a2-09de886cab43 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.150628 May 25 14:57:08.374150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 196/410] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:08 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:08.845101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:08.846397 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:08.853073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.853548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:08.854364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:08.854831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:09.015889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:09.023269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f747a743-6e26-454e-8bcc-9f6b8edc650f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.182060 May 25 14:57:09.023834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 215/411] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:08 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:09.389705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:09.390235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:09.396834 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:09.397304 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:09.398075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:09.398506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:09.525331 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:09.532672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3dad661c-baf0-4510-8ca2-0638cb1efe9d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.146903 May 25 14:57:09.533234 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 197/412] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:09 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:10.040116 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:10.040762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:10.046878 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.054752 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.054752 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.054752 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.173788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:10.190625 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e24628b5-10bc-4174-be0e-3b8e7c06dccf tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.153081 May 25 14:57:10.191250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 216/413] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:10 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:10.549426 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:10.550031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:10.557100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.557547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.558309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:10.558773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:10.684382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:10.692001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b92265f3-4a37-45ec-b59b-f27292a0b787 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.146605 May 25 14:57:10.692557 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 198/414] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:10 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:11.208482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:11.209339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:11.216098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:11.216416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.217189 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:11.217627 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.344577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:11.352348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bad5b380-8e06-400b-9393-5978b63462f1 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.147674 May 25 14:57:11.352911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 217/415] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:11 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:11.708648 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:11.709207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:11.715687 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:11.716140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.716904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:11.717377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:11.845710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:11.853726 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ae87ea64-178a-45e0-be50-b287cf6349a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1314 microversion: 2.1 time: 0.148995 May 25 14:57:11.854297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 199/416] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:11 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:12.368864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:12.369434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:12.375441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.375885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.376663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.377386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.504390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:12.511874 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bc5c01f7-91eb-4a8f-8ff2-75606a96532e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.147069 May 25 14:57:12.512436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 218/417] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:12 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:12.870877 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:12.871489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:12.878275 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.878763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:12.879539 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:12.879980 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.016777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:13.024551 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-112640f3-483f-4b77-9d96-0f51be95af3d tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1498 microversion: 2.1 time: 0.158201 May 25 14:57:13.025112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 200/418] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:12 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:13.528496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:13.529405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:13.535375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.535819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.536601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:13.537034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:13.670090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:13.681713 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-02e56d0f-e924-48da-9240-b17689056e8d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.156164 May 25 14:57:13.682365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 219/419] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:13 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:14.698866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:14.699481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:14.705877 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:14.706330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:14.707170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:14.707553 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:14.789658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:14.790217 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:14.796354 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:14.796793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:14.797626 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:14.798057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:14.825284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 14:57:14.843895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:14.852021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-45d25545-4d27-4747-87c4-362ada1a870b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.157655 May 25 14:57:14.853082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 201/420] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:14 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:15.001225 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a8b9fcfe-0db6-4faf-b92f-513a4b018771 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "DELETE /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 204 len: 0 microversion: 2.1 time: 0.215315 May 25 14:57:15.001812 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 220/421] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 14:57:14 2022] DELETE /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 14:57:15.010000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:15.010612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:15.019129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.019584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:15.020363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.020800 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:15.368053 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:15.370702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:15.376605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9f59ca50-6a38-49ab-b6ad-a621407ce859 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1504 microversion: 2.1 time: 0.370463 May 25 14:57:15.377164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 202/422] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:15 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:15.869825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:15.870528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:15.877130 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.877579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:15.878403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:15.878817 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:16.008735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:16.017313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-32baf13a-83f6-4c7a-94a5-3f573679cae6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.151548 May 25 14:57:16.017883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 221/423] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:15 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:16.393702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:16.396054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:16.400921 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:16.401365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:16.402300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:16.402758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:16.535577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:16.543768 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d70b837d-b52e-4a28-ac4c-fc531167b22b tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1504 microversion: 2.1 time: 0.154384 May 25 14:57:16.544360 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 203/424] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:16 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:17.033948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:17.034567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:17.040985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:17.041432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:17.043115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:17.043115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:17.175995 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:17.184112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-159cae7f-f7f3-4d78-ae43-7dc707e108f7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.153987 May 25 14:57:17.184674 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 222/425] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:17 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:17.561502 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:17.562148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:17.569028 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:17.569482 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:17.570251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:17.570712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:17.700011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:17.707603 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-92c5696f-5146-45dd-a43b-6480551bfe69 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1504 microversion: 2.1 time: 0.149863 May 25 14:57:17.708138 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 204/426] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:17 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:18.199942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:18.200558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:18.206747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:18.207218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:18.207982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:18.208401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:18.334782 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:18.342699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6e11dbfc-e6b2-4a6b-9b66-8d6790694bbe tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.146528 May 25 14:57:18.343260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 223/427] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:18 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:18.724302 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:18.724915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:18.731797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:18.732252 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:18.733022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:18.733463 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:18.861005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:18.868524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7eb3cb53-20bc-45b8-84c1-2dd704d430f5 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1504 microversion: 2.1 time: 0.148073 May 25 14:57:18.869083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 205/428] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:18 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:19.359850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:19.360459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:19.366424 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:19.366910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:19.367669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:19.368099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:19.497604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:19.505125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ece3225a-2ff7-477b-ab68-031a8c828ead tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.149136 May 25 14:57:19.505669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 224/429] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:19 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:19.885330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:19.885934 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:19.892354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:19.892796 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:19.893554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:19.893985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:20.018872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:20.026996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b2af1f75-925f-4f75-beec-440f224160a6 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1504 microversion: 2.1 time: 0.145548 May 25 14:57:20.027561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 206/430] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:19 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:20.521543 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:20.522070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:20.528128 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:20.528571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:20.529323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:20.529753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:20.658572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:20.666019 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-571e4ca9-f2f8-4326-81de-b23ee605d754 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.148558 May 25 14:57:20.666593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 225/431] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:20 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:57:21.044872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:21.045489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:21.051988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:21.052440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:21.053237 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:21.053674 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:21.194194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:21.201746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c1f6a37c-526f-476d-b37d-8d162ca74f03 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1504 microversion: 2.1 time: 0.161326 May 25 14:57:21.202305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 207/432] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:21 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:21.682779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:21.683398 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:21.689841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:21.690353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:21.691163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:21.691601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:21.708468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:21.830724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:21.838766 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-30a53cc4-ba26-48e5-a7b7-2d3e0acfa56d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.160003 May 25 14:57:21.843459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 226/433] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:21 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:22.174581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-312441d1-d756-4f58-80d6-8d3ac00e14b3 req-eee9e616-4ab3-4168-9e9e-0df89b6926f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1228e9-2eea-49b9-a684-e2d94a8a103f", "name": "network-vif-deleted", "tag": "e7c11888-837a-4003-86b7-15a681a1d925"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:22.183987 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-312441d1-d756-4f58-80d6-8d3ac00e14b3 req-eee9e616-4ab3-4168-9e9e-0df89b6926f1 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.184425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-312441d1-d756-4f58-80d6-8d3ac00e14b3 req-eee9e616-4ab3-4168-9e9e-0df89b6926f1 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:22.198721 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-312441d1-d756-4f58-80d6-8d3ac00e14b3 req-eee9e616-4ab3-4168-9e9e-0df89b6926f1 service nova] Creating event network-vif-deleted:e7c11888-837a-4003-86b7-15a681a1d925 for instance de1228e9-2eea-49b9-a684-e2d94a8a103f on hv-cinder-83028 May 25 14:57:22.204031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-312441d1-d756-4f58-80d6-8d3ac00e14b3 req-eee9e616-4ab3-4168-9e9e-0df89b6926f1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 May 25 14:57:22.204639 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 208/434] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:22.218178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:22.219026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:22.220921 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:22.226054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.226509 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:22.227324 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.227765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:22.297960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:22.307196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c921e5b8-07d5-4d5c-ba53-c9d28d29d329 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1462 microversion: 2.1 time: 0.093538 May 25 14:57:22.312917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 227/435] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:22 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:22.858903 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:22.859842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:22.866708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.867700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:22.869009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:22.869623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.022222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:23.030871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4bb8ad09-2c71-4928-9a1a-a12e2eb7a44c tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.177660 May 25 14:57:23.031617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 209/436] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:22 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:23.325315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:23.331536 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:23.338901 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.339177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.340062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:23.340570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:23.420955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:23.428814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3b141ad8-607e-4a55-afb0-aa194b2f4cbc tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1462 microversion: 2.1 time: 0.108279 May 25 14:57:23.440312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 228/437] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:23 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:24.047417 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:24.048022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:24.054402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.054888 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.055655 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.056127 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.192632 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:24.202550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2b853090-b416-460b-aa14-e65eae373d17 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.158384 May 25 14:57:24.203136 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 210/438] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:24 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:24.447681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:24.448307 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:24.454554 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.455042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.455819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.456261 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.486628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:24.487105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:24.487560 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lazy-loading 'fault' on Instance uuid de1228e9-2eea-49b9-a684-e2d94a8a103f {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:57:24.532467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:24.540961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a3386bf7-535a-48c3-a4d4-52c90133e634 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1304 microversion: 2.1 time: 0.097904 May 25 14:57:24.541737 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 229/439] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:24 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:25.220243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:25.220935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:25.230572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.231142 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.232362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.232882 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.376342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:25.384603 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1bbac5f1-3492-4baa-b3de-5f8a1ef7224a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.168592 May 25 14:57:25.385170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 211/440] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:25 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:25.562523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:25.563178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:25.569658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.570109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.572200 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.577740 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.612356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:25.612864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:25.613312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lazy-loading 'fault' on Instance uuid de1228e9-2eea-49b9-a684-e2d94a8a103f {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:57:25.653591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7792f354950d41a3b0b81267cd2714cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fe34cb175740b299804b8c9d2f3371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:25.661076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-973e9d48-07f7-44a3-9116-89c8426caf71 tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 200 len: 1304 microversion: 2.1 time: 0.106845 May 25 14:57:25.663406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 230/441] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:25 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:26.401804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:26.402410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:26.409316 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.409778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.410556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.411013 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.553980 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:26.560541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-84139517-5ebf-4113-81ab-2c75113af25d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1502 microversion: 2.1 time: 0.163167 May 25 14:57:26.561186 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 212/442] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:26 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:26.577899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e0cdb91-5ae3-4b98-aad0-df75960c4cbc"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:26.580073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:26.586298 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.589410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.589410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.589410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.611278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] HTTP exception thrown: Cannot 'attach_volume' instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 while it is in vm_state rescued May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Request method failure captured: May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/os-volume_attachments HTTP/1.1 May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 74 May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM_Vk83bilkooRtRyNfZ03pTLQ46Z4dkY0pafDfliwcXZXeOL10HsXQdbsAipIeUJCS_oCw2ccokZeDrNK7tdbnTao9ipYt4QAA_MzzOHO84y567uZ3_xoltAiEvDDCHHMkU7H5Kd5O16_wICPHP9PXJTZBJAE639mbjn9JeflJXSI May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 9263e6d657dd458d9f497bb868adb941 May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:57:26.613180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9263e6d657dd458d9f497bb868adb941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}] May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 9263e6d657dd458d9f497bb868adb941 May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: becb6feb52b643279066aef1a7a9f063 May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {"volumeAttachment": {"volumeId": "9e0cdb91-5ae3-4b98-aad0-df75960c4cbc"}} May 25 14:57:26.614697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Cannot 'attach_volume' instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 while it is in vm_state rescued May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'server_id': '54c1f5bd-4a13-4a35-9607-5bbff2d886e0', 'body': {'volumeAttachment': {'volumeId': '9e0cdb91-5ae3-4b98-aad0-df75960c4cbc'}}} May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:26.619955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 while it is in vm_state rescued May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:26.621313 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 while it is in vm_state rescued May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Returning 409 to user: Cannot 'attach_volume' instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 while it is in vm_state rescued {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9b57116f-00c5-4a5b-ac04-b7398c624958 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041328 May 25 14:57:26.622581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 231/443] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 14:57:26 2022] POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 14:57:26.628856 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:26.629383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:26.636016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.636468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.637230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.637665 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.678453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:26.679198 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] [instance: de1228e9-2eea-49b9-a684-e2d94a8a103f] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:26.686805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.687388 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.688271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.689049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.703589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] HTTP exception thrown: Instance de1228e9-2eea-49b9-a684-e2d94a8a103f could not be found. May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Request method failure captured: May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f HTTP/1.1 May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkOGU679kOMgyZ3Bzx1oNeAHKzUt19mDRp-VYx_vvofgdnPBFY5CgjIfzr6SOVgHs1r9hYefSJhjmj4wOxZUl_jPy1cygqeAjW5twTineThFVn_xuNyvi5_UDeUT1n1v1yrvVj6uQ4c9YeFUyv_2fl8I2MAayjUo_PTNnGbT3dB8k9U May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: f3fe34cb175740b299804b8c9d2f3371 May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesActionsTest-1430424166 May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 14:57:26.705315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f3fe34cb175740b299804b8c9d2f3371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f3fe34cb175740b299804b8c9d2f3371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f3fe34cb175740b299804b8c9d2f3371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f3fe34cb175740b299804b8c9d2f3371"}]}] May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesActionsTest-1430424166 May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: f3fe34cb175740b299804b8c9d2f3371 May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesActionsTest-1430424166 May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesActionsTest-1430424166-project May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 7792f354950d41a3b0b81267cd2714cc May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesActionsTest-1430424166-project May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance de1228e9-2eea-49b9-a684-e2d94a8a103f could not be found. May 25 14:57:26.706794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'de1228e9-2eea-49b9-a684-e2d94a8a103f'} May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1228e9-2eea-49b9-a684-e2d94a8a103f could not be found. May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 14:57:26.707703 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1228e9-2eea-49b9-a684-e2d94a8a103f could not be found. May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1228e9-2eea-49b9-a684-e2d94a8a103f could not be found. May 25 14:57:26.708983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 14:57:26.710186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] Returning 404 to user: Instance de1228e9-2eea-49b9-a684-e2d94a8a103f could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 14:57:26.710186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-59aafba6-fa6b-4e52-8b57-ae9bcaa1619a tempest-VolumesActionsTest-1430424166 tempest-VolumesActionsTest-1430424166-project] 10.222.0.74 "GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f" status: 404 len: 111 microversion: 2.1 time: 0.032648 May 25 14:57:26.710186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 232/444] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:26 2022] GET /compute/v2.1/servers/de1228e9-2eea-49b9-a684-e2d94a8a103f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 14:57:26.900206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-73cd0df1-cb37-4065-8ee2-34d87769146f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/action" status: 202 len: 0 microversion: 2.1 time: 0.275300 May 25 14:57:26.904020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 213/445] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 14:57:26 2022] POST /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:57:26.909113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:26.909921 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:26.917343 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.917818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:26.918552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:26.919034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:27.055495 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:27.067721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-72885e6d-8b7c-4c5e-bd61-8dc8451c7aab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.162314 May 25 14:57:27.068604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 233/446] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:26 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:28.086224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:28.086973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:28.093794 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.094425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.095227 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:28.095666 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:28.234071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:28.243080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1bf3b1e9-0cf8-4036-9d7e-b7fff6f6b11b tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.161453 May 25 14:57:28.244281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 214/447] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:28 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:29.261082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:29.261691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:29.267815 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:29.268265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:29.269031 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:29.269466 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:29.395565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:29.403471 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c3beb67f-961f-44dc-9180-dda81a08d6ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.146765 May 25 14:57:29.404028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 234/448] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:29 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:30.420796 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:30.421434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:30.423891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=58 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:30.428688 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.429135 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.429898 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:30.430334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:30.559681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:30.567295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-497d35ac-cf3a-4964-9f4c-bdd604152193 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.150496 May 25 14:57:30.567863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 215/449] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:30 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:31.585065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:31.585603 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:31.591645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:31.592097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:31.592865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:31.593311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:31.720626 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:31.728695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bdb62bbc-3ea1-41db-bca1-9eb550ed391e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.147103 May 25 14:57:31.729265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 235/450] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:31 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:32.745780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:32.746387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:32.753268 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:32.753727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:32.754504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:32.754974 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:32.879560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:32.886935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cc7d20de-46de-4e58-825b-18cb55a24122 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.145460 May 25 14:57:32.887505 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 216/451] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:32 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:33.904167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:33.904773 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:33.910794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:33.911241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:33.912001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:33.912432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:34.041799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:34.049596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-473f6055-0b28-46e8-a4fc-71907bb867d2 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1510 microversion: 2.1 time: 0.149688 May 25 14:57:34.050155 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 236/452] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:33 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:35.068413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:35.069023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:35.076401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:35.076854 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:35.077634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:35.078117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:35.248087 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:35.257810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2538b8d8-5c6b-48f3-9d99-5f3dba3aa9a5 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1516 microversion: 2.1 time: 0.193678 May 25 14:57:35.258112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 217/453] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:35 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:38.220574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a93dead2-a0f8-4c09-b8df-7170ce65c0ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'create', calling method: .version_select at 0x7f6fb496b790>, body: {"keypair": {"name": "tempest-keypair-1845499951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEgYEy/pMtbifdlgKRp9W/NIbsYnYbyYora0FKQmkagaWvMrWCMTXvDtIf+S64TOd2vgBHlNvdQew5Ax+V4ORJaXMo6K6OMkI73+q3+CtHHQ6YMqZvjlH5pm9+/IWozw=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:38.237749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-a93dead2-a0f8-4c09-b8df-7170ce65c0ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for project 9263e6d657dd458d9f497bb868adb941. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:57:38.242504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-a93dead2-a0f8-4c09-b8df-7170ce65c0ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for user becb6feb52b643279066aef1a7a9f063 and project 9263e6d657dd458d9f497bb868adb941. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:57:38.351266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a93dead2-a0f8-4c09-b8df-7170ce65c0ec tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134366 May 25 14:57:38.358192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 237/454] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 14:57:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:41.017763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-544978052", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1af7d524-3bf7-4e87-bf8e-df0a6b0097e3"}], "security_groups": [{"name": "tempest-securitygroup--1709187525"}], "key_name": "tempest-keypair-1845499951", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:41.131887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] validate_networks() for [('1af7d524-3bf7-4e87-bf8e-df0a6b0097e3', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:57:41.587541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:57:41.590885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:57:41.590885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:57:41.590885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:57:41.590885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:57:41.607349 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:41.608035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:41.609008 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:41.609678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:41.627785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for project 9263e6d657dd458d9f497bb868adb941. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:57:41.632130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Getting quotas for user becb6feb52b643279066aef1a7a9f063 and project 9263e6d657dd458d9f497bb868adb941. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:57:41.645715 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:57:41.659796 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:57:41.795040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b79a56a8-a8b9-4893-b71c-c6678afaaa8e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.781206 May 25 14:57:41.800895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 218/455] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:57:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:57:41.806853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4b200bf8-0afb-4089-8fc9-4ec035726b97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:41.807588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4b200bf8-0afb-4089-8fc9-4ec035726b97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:41.918982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4b200bf8-0afb-4089-8fc9-4ec035726b97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:41.927123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4b200bf8-0afb-4089-8fc9-4ec035726b97 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1245 microversion: 2.1 time: 0.124830 May 25 14:57:41.928784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 238/456] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:41 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:42.946190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:42.949076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:42.957971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:42.958423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:42.959580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:42.960188 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:43.031951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:43.031951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:43.037692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-eb9c37d0-d449-4a78-9604-f745b734b924 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1249 microversion: 2.1 time: 0.096167 May 25 14:57:43.038323 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 219/457] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:42 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:44.058440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:44.059878 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:44.063963 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=61 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:44.069296 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.070135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.071931 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:44.072617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:44.160919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:44.171367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f9a3099a-6660-4ec5-9e9e-f6ee5512e069 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1297 microversion: 2.1 time: 0.118966 May 25 14:57:44.172299 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 239/458] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:44 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:45.189745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:45.191018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:45.199168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:45.199885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:45.200889 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:45.201556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:45.263703 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:45.270851 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ec97d9e4-8924-4b79-bc41-07ef52851fe9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1297 microversion: 2.1 time: 0.085461 May 25 14:57:45.271408 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 220/459] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:45 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:46.289399 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:46.290935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:46.299161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:46.299852 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:46.300996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:46.301678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:46.391382 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:46.401297 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9a6af567-5fd4-4083-a5aa-1ea0361dcfd8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1297 microversion: 2.1 time: 0.117471 May 25 14:57:46.402432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 240/460] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:46 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:47.419357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:47.419897 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:47.429123 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:47.429939 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:47.432033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:47.432871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:47.498448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:47.505793 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f1c94f21-3501-49f5-a832-f83071caffdc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1297 microversion: 2.1 time: 0.091406 May 25 14:57:47.506362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 221/461] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:47 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:48.522406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:48.523045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:48.529085 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:48.529532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:48.530287 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:48.530756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:48.595401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:48.603793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8e30bf5d-4570-4c78-9a5c-3e4c8a704cf6 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1297 microversion: 2.1 time: 0.085209 May 25 14:57:48.604356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 241/462] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:48 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:49.622538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:49.623947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:49.632328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:49.634359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:49.634359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:49.635026 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:49.708896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:49.719003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e383195f-9978-4e71-b007-a98495010d13 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1303 microversion: 2.1 time: 0.101319 May 25 14:57:49.719790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 222/463] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:49 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:50.737927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:50.738604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:50.755092 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:50.757502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:50.758441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:50.759483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:50.984407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:50.997641 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a7d09aff-88bc-49b4-a977-4d901baf4f95 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.259693 May 25 14:57:51.000446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 242/464] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:50 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:51.235845 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-cbd32b5d-ba7b-48b4-9cbd-1a660af36bc6 req-ebc5a669-13f1-4d55-9c8c-3e9b35fd218a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2529df8-e20b-49ac-a79a-3591457940dd", "tag": "9e663dba-92f0-4076-8dd2-b498d22380ee"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:57:51.253581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-cbd32b5d-ba7b-48b4-9cbd-1a660af36bc6 req-ebc5a669-13f1-4d55-9c8c-3e9b35fd218a service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:51.254969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-cbd32b5d-ba7b-48b4-9cbd-1a660af36bc6 req-ebc5a669-13f1-4d55-9c8c-3e9b35fd218a service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:51.280018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-cbd32b5d-ba7b-48b4-9cbd-1a660af36bc6 req-ebc5a669-13f1-4d55-9c8c-3e9b35fd218a service nova] Creating event network-changed:9e663dba-92f0-4076-8dd2-b498d22380ee for instance f2529df8-e20b-49ac-a79a-3591457940dd on hv-cinder-83028 May 25 14:57:51.288876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-cbd32b5d-ba7b-48b4-9cbd-1a660af36bc6 req-ebc5a669-13f1-4d55-9c8c-3e9b35fd218a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056013 May 25 14:57:51.292340 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 223/465] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:57:52.017421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:52.026959 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:52.037429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=6 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:52.041516 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:52.043178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:52.044612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:52.048667 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:52.209213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:52.220795 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e9b8fbd6-3228-44bf-ac64-6d8ce15f549f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.207512 May 25 14:57:52.221935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 243/466] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:52 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:53.234686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:53.235431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:53.240591 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:53.245969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:53.248169 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:53.248623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:53.249396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:53.249832 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:53.423577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:53.431724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-181b1fc3-2fb5-4975-9e40-50ae2ad80011 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.197973 May 25 14:57:53.433741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 224/467] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:53 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:54.450005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:54.451276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:54.453122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:57:54.457806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:54.458250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:54.459051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:54.459566 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:54.617841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:54.628885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b26bd8a2-a196-4ac2-ab83-99a176c44045 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.183263 May 25 14:57:54.629489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 244/468] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:54 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:55.647143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:55.650489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:55.660577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:55.661712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:55.663690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:55.664859 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:55.816992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:55.829204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-381a8777-0c3b-4e6b-b673-d30b8a53b31f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.186687 May 25 14:57:55.840784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 225/469] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:55 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:56.848364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:56.848787 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:56.855365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:56.855972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:56.856715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:56.857150 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:56.997084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:57.005103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6752afe9-28dd-4e46-b986-b38d94791792 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.161184 May 25 14:57:57.005702 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 245/470] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:56 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:58.022284 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:58.022929 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:58.030809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:58.031258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:58.032315 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:58.032824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:58.159088 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:58.167146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-80fe3803-d80a-4da3-8a3a-6359e819d7e4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.148579 May 25 14:57:58.167715 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 226/471] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:58 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:57:58.579090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 14:57:58.579583 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 14:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 14:57:59.184263 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:57:59.184877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:57:59.191295 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:59.191744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:59.192503 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:57:59.192937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:57:59.322092 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:57:59.329570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e1a38763-71d4-4027-bf8e-0701a15ee1f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.149670 May 25 14:57:59.330138 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 246/472] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:57:59 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:00.346346 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:00.346980 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:00.354205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:00.354669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:00.355424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:00.355853 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:00.484340 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:00.491787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ce46691d-e60a-44b3-8ce0-3a14a53ec6ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.149423 May 25 14:58:00.492356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 227/473] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:00 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:01.508523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:01.509136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:01.515467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:01.515917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:01.516678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:01.517120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:01.643304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:01.650827 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3ed5dacb-0bba-4172-81b9-8a62946c5f51 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.146165 May 25 14:58:01.651418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 247/474] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:01 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:02.668129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:02.668676 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:02.671068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:02.675870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:02.676808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:02.677072 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:02.677507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:02.807487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:02.815264 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c3e1d0c4-d401-4a8d-890a-177d4b33c84d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.151911 May 25 14:58:02.815824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 228/475] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:02 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:03.832429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:03.833047 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:03.839167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:03.839616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:03.840381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:03.840819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:03.967251 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:03.975892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a97b4423-0d29-417c-bf66-29d14c5ee273 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.147245 May 25 14:58:03.976523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 248/476] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:03 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:04.993248 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:04.993858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:05.000554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:05.001030 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:05.001814 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:05.002274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:05.133075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:05.140232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-18794224-42ce-4860-9864-a3147efe0537 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.150812 May 25 14:58:05.149402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 229/477] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:04 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:06.158125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:06.158782 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:06.165391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:06.168416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:06.168416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:06.168416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:06.305996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:06.315051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c7e048de-c46e-4c07-83a7-eea4bd4b17d9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.161657 May 25 14:58:06.315699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 249/478] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:06 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:07.332114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:07.332600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:07.338951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:07.340325 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:07.341141 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:07.341612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:07.477529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:07.485489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0b168559-2ec4-4dca-8869-cdc79ac0e8a8 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.157512 May 25 14:58:07.486274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 230/479] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:07 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:07.562585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-51644c0c-c1bd-4ed3-a373-2e0718851927 req-fdf1b0a1-bca1-4195-b7a0-8db87312d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2529df8-e20b-49ac-a79a-3591457940dd", "name": "network-vif-plugged", "status": "completed", "tag": "9e663dba-92f0-4076-8dd2-b498d22380ee"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:07.571828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-51644c0c-c1bd-4ed3-a373-2e0718851927 req-fdf1b0a1-bca1-4195-b7a0-8db87312d3b1 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:07.572338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-51644c0c-c1bd-4ed3-a373-2e0718851927 req-fdf1b0a1-bca1-4195-b7a0-8db87312d3b1 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:07.583915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-51644c0c-c1bd-4ed3-a373-2e0718851927 req-fdf1b0a1-bca1-4195-b7a0-8db87312d3b1 service nova] Creating event network-vif-plugged:9e663dba-92f0-4076-8dd2-b498d22380ee for instance f2529df8-e20b-49ac-a79a-3591457940dd on hv-cinder-83028 May 25 14:58:07.589414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-51644c0c-c1bd-4ed3-a373-2e0718851927 req-fdf1b0a1-bca1-4195-b7a0-8db87312d3b1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 May 25 14:58:07.590123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 250/480] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:08.502741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:08.503395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:08.509952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:08.510403 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:08.511199 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:08.511628 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:08.648335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:08.656340 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2e1c1225-e13c-490a-bb69-7cfa4ec40352 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.157788 May 25 14:58:08.657574 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 231/481] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:08 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:09.674513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:09.675330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:09.681647 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:09.682096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:09.682894 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:09.683335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:09.818716 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:09.826404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c272b4da-068f-4527-9cf4-f284949c52e3 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1371 microversion: 2.1 time: 0.155969 May 25 14:58:09.826998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 251/482] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:09 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:10.843800 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:10.844451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:10.852941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:10.853487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:10.854273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:10.854942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:10.999644 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:11.007001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4b2c0753-a146-4d5c-a960-5f1b30ef9545 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1565 microversion: 2.1 time: 0.167909 May 25 14:58:11.007567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 232/483] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:58:10 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:58:11.023810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:11.024300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:11.030934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:11.031379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:11.032137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:11.032591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:11.112100 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e7e99b22-9117-4737-8259-e626c1958c46 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092119 May 25 14:58:11.112718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 252/484] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 14:58:11 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:12.350512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-84f440dd-490f-4f19-9f01-27191785c4db req-322b5f67-0b28-45cb-ba71-e0aac4618c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2529df8-e20b-49ac-a79a-3591457940dd", "tag": "9e663dba-92f0-4076-8dd2-b498d22380ee"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:12.359751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-84f440dd-490f-4f19-9f01-27191785c4db req-322b5f67-0b28-45cb-ba71-e0aac4618c55 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:12.360195 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-84f440dd-490f-4f19-9f01-27191785c4db req-322b5f67-0b28-45cb-ba71-e0aac4618c55 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:12.371637 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-84f440dd-490f-4f19-9f01-27191785c4db req-322b5f67-0b28-45cb-ba71-e0aac4618c55 service nova] Creating event network-changed:9e663dba-92f0-4076-8dd2-b498d22380ee for instance f2529df8-e20b-49ac-a79a-3591457940dd on hv-cinder-83028 May 25 14:58:12.380187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-84f440dd-490f-4f19-9f01-27191785c4db req-322b5f67-0b28-45cb-ba71-e0aac4618c55 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030145 May 25 14:58:12.380187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 233/485] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:14.095635 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 14:58:14.096301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 14:58:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 14:58:49.056726 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=17 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:49.057628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=78 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:49.063113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:49.063682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:49.070433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.070983 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.072083 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.072529 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.097922 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2c662e21-5ead-478a-b2da-6b3825665112 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/ips" status: 200 len: 150 microversion: 2.1 time: 0.042071 May 25 14:58:49.105565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 253/486] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 14:58:49 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:49.136669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=11 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:49.138666 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=77 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:49.144133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:49.145116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:49.154082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.156257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.156257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.156257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.195485 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3cd06bc4-0246-4bad-a522-4608457cd496 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/ips" status: 200 len: 145 microversion: 2.1 time: 0.060716 May 25 14:58:49.196478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 234/487] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 14:58:49 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/ips => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:49.321811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:49.332535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:49.338088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.339182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.340039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:49.340535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:49.395193 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1732f60a-e362-4575-bb0d-f5f0fa8bcf3f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/ips" status: 200 len: 152 microversion: 2.20 time: 0.081998 May 25 14:58:49.397180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 254/488] 10.222.0.74 () {60 vars in 1288 bytes} [Wed May 25 14:58:49 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/ips => generated 152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:58:52.105943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65bb4738-2700-4a2e-a765-e83f3f4b3c19"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:52.107140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:52.114761 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:52.119092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:52.119092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:52.119092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.053803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:53.057027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:53.064186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.065056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.067393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.070920 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.126226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lazy-loading 'flavor' on Instance uuid 1f09fd70-df36-4976-a829-ebe720c7e516 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 14:58:53.382375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-746ce9b0-c029-4ad9-a3fc-6cbd31492f84 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.287711 May 25 14:58:53.383067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 235/489] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 14:58:52 2022] POST /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:53.390934 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "885c9970-826c-4548-b8ac-0d37deebacd1"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:58:53.392496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:53.407687 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.408243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.409089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.409797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.893348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2b1ffb00-771a-4ad2-ac27-25d592bd5dda tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/action" status: 202 len: 0 microversion: 2.20 time: 0.843566 May 25 14:58:53.896718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 255/490] 10.222.0.74 () {62 vars in 1318 bytes} [Wed May 25 14:58:53 2022] POST /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 14:58:53.906598 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:53.907336 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:53.920484 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.921099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:53.922205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:53.923205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:54.085220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:54.095987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:54.098616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:54.100460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f8c08086-37d3-49c6-b022-07cf00db4de4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.198143 May 25 14:58:54.109914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 256/491] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:58:53 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:58:54.510056 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5dbb0ce5-a3bb-4c00-bef1-2ccc4434194e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125248 May 25 14:58:54.510807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 236/492] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 14:58:53 2022] POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:58:55.121512 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:55.122921 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:55.138488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:55.138488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:55.138488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:55.138488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:55.361425 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:55.371142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:55.385649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:55.385649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f9716c7e-0242-4606-b40d-5590380634b7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.256854 May 25 14:58:55.385649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 257/493] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:58:55 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:58:56.394325 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:56.395338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:56.407230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:56.407682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:56.411550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:56.411550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:56.690135 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:56.701649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:56.708466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:56.709685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1a68ef37-0472-4b52-8ff3-130d30f60d03 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.320287 May 25 14:58:56.720945 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 237/494] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:58:56 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:58:57.728609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:57.729228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:57.736832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:57.737849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:57.738595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:57.739075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:57.998494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:58.009379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:58.011557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:58.013015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dd3a7f05-7d03-4a0d-b305-57a51f62e173 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.288258 May 25 14:58:58.013580 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 258/495] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:58:57 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:58:59.030937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:58:59.032070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:58:59.039736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:59.040118 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:59.040752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:58:59.041370 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:58:59.241723 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:59.253606 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:59.256809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:58:59.258085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8972467c-5e8c-4b1e-8050-75ebdebcdb4b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.231400 May 25 14:58:59.259558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 238/496] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:58:59 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:00.277210 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:00.277831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:00.291626 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:00.300682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:00.300682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:00.300682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:00.503836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:00.515486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:00.517427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:00.519805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-65f0e5e1-1f2a-4e25-9881-8154c7713325 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.246746 May 25 14:59:00.520990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 259/497] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:00 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:01.541647 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:01.542510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:01.551719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:01.552328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:01.553309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:01.553919 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:01.768181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:01.779673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:01.788765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:01.788765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1fa61bf5-77f4-4499-8639-5322e573b67c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.247186 May 25 14:59:01.788765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 239/498] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:01 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:02.801439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:02.802256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:02.808431 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:02.808882 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:02.809661 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:02.810097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:02.960095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:02.969690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:02.971331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:02.972616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2adf5bb6-578d-4ff4-939e-a0d75dc2436a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.175110 May 25 14:59:02.973758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 260/499] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:02 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:03.308013 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e7e224b9-a813-4eec-bac0-d60f85a7660f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: .version_select at 0x7f6fb48fac10>, body: {"keypair": {"name": "tempest-keypair-459565512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIFLB/sE+LcA/kG+C1XH3KnfuDwZZJ49AveJDYablfLaSbpDRpzY1aqQUUk643hWwRnCjsUPLW/B1IitI8tDLlDIDjdLnFOHNcmVbACPe7y0KcKb2LKpzjNNYQQ1bQ9xA=="}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:03.318624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-e7e224b9-a813-4eec-bac0-d60f85a7660f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:03.323307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-e7e224b9-a813-4eec-bac0-d60f85a7660f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:03.444840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e7e224b9-a813-4eec-bac0-d60f85a7660f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146974 May 25 14:59:03.450689 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 240/500] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 14:59:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:03.994147 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:03.994147 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:04.000419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:04.003266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:04.003266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:04.003266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:04.204899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:04.216415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:04.219118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:04.220767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a3ff5c40-a594-47b9-a761-f24f6d210d5b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.231294 May 25 14:59:04.221686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 261/501] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:03 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:05.263554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:05.264896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:05.278089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:05.282267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:05.283305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:05.284433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:05.489038 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:05.499286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:05.500811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:05.502005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cc91c57e-2856-46ab-bbd7-32c5c460762e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.265706 May 25 14:59:05.502555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 241/502] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:05 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:06.521169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:06.522095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:06.528775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:06.529226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:06.530524 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:06.531092 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:06.602404 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1285960330", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa952598-36d5-42ef-b4ac-0f4017a94969"}], "security_groups": [{"name": "tempest-securitygroup--1216114859"}], "key_name": "tempest-keypair-459565512", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:06.716383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:06.724864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:06.726556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:06.727888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d3261dff-ab08-4f76-bdc2-556b53ac91e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.211321 May 25 14:59:06.739169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 262/503] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:06 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:06.756546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] validate_networks() for [('fa952598-36d5-42ef-b4ac-0f4017a94969', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:59:07.177534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:59:07.178034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:59:07.178513 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:59:07.178952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:59:07.179532 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:59:07.190829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.195406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.196490 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.196931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.215731 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:07.220020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:07.234009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:59:07.236705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:59:07.404680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-65815d7a-6eca-493a-87c5-7725d928110c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.806884 May 25 14:59:07.405329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 242/504] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:59:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:59:07.421300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ed239336-7d14-4612-8e4c-9b6af18f5ad0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:07.421888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ed239336-7d14-4612-8e4c-9b6af18f5ad0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:07.483685 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ed239336-7d14-4612-8e4c-9b6af18f5ad0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:07.493594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ed239336-7d14-4612-8e4c-9b6af18f5ad0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1241 microversion: 2.1 time: 0.077779 May 25 14:59:07.494761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 263/505] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:07 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:07.748093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:07.748707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:07.760134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.760586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.761375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:07.764112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:07.921395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:07.930059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:07.932019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:07.933473 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8c2d0537-0242-491f-9a41-7f5c82d588ff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.189307 May 25 14:59:07.948913 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 243/506] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:07 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:08.516614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b32a9b70-1632-421a-b64f-94ea1c2223e2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:08.516614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b32a9b70-1632-421a-b64f-94ea1c2223e2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:08.582880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b32a9b70-1632-421a-b64f-94ea1c2223e2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:08.591563 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b32a9b70-1632-421a-b64f-94ea1c2223e2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1241 microversion: 2.1 time: 0.084109 May 25 14:59:08.601345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 264/507] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:08 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:08.955968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:08.957162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:08.963993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:08.964650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:08.965577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:08.966158 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:09.133869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:09.143806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:09.147858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:09.147858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7fb89485-a589-4030-b3b4-484be3a6a1ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.194723 May 25 14:59:09.147858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 244/508] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:08 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:09.608506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e31f220a-72d6-45b0-a703-83570f459eb9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:09.609133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e31f220a-72d6-45b0-a703-83570f459eb9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:09.672953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e31f220a-72d6-45b0-a703-83570f459eb9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:09.682259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e31f220a-72d6-45b0-a703-83570f459eb9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1241 microversion: 2.1 time: 0.077450 May 25 14:59:09.684013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 265/509] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:09 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:10.166087 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:10.166895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:10.175515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:10.176370 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:10.177466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:10.178056 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:10.362367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:10.370572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:10.372333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:10.373494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b6b9d94f-a5ce-4805-9492-c0ba6dc702ec tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.211473 May 25 14:59:10.374046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 245/510] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:10 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:10.701719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3f6eabac-d368-42f0-b642-6481254da8f0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:10.703215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3f6eabac-d368-42f0-b642-6481254da8f0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:10.763201 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3f6eabac-d368-42f0-b642-6481254da8f0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:10.772558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3f6eabac-d368-42f0-b642-6481254da8f0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1241 microversion: 2.1 time: 0.074920 May 25 14:59:10.773706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 266/511] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:10 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:10.831623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a56cc566-8ff1-4edf-acff-522f16ec601e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Action: 'create', calling method: .version_select at 0x7f6fb4945940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1597081167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHcw495AmO+EwYYlTTZq05F7uK96EsSDxPvsmTV1FWlJBo9bOLcktgc+e+hnmIStf/3mUUNcrOK2XVMZZ349ipQELKOL4laYQ+uNbKjAxmhpZLgvkWE+EQFTvqHHpii8A=="}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:10.845399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-a56cc566-8ff1-4edf-acff-522f16ec601e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Getting quotas for project bb0ee163dc0c4237aaa4e2efb85878fc. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:10.850758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-a56cc566-8ff1-4edf-acff-522f16ec601e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Getting quotas for user 479781403bb94b9788fd589f838fea3f and project bb0ee163dc0c4237aaa4e2efb85878fc. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:10.997462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a56cc566-8ff1-4edf-acff-522f16ec601e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.170231 May 25 14:59:10.998222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 246/512] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 14:59:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:11.099747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-982705401", "imageRef": "d4f9926c-33bd-4c90-9ccf-897330beb672", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1597081167", "networks": [{"uuid": "dc778cfe-9dc1-4f11-88d2-3117c0b8ecd1"}]}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:11.149431 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.network.neutron [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] validate_networks() for [('dc778cfe-9dc1-4f11-88d2-3117c0b8ecd1', None, None, None, None, None)] {{(pid=129908) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 14:59:11.392078 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:11.394269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:11.401161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.401847 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.403317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.403770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.621836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:11.631165 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:11.633394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:11.634807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-488c6c9d-a9f1-4c4a-916d-7e2ed27d5a87 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.246682 May 25 14:59:11.636870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 247/513] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:11 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:11.665788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Flavor limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 14:59:11.666318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Image limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 14:59:11.667010 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Flavor pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 14:59:11.667592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Image pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 14:59:11.668015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 14:59:11.677885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.678781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.679653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.680309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.699067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Getting quotas for project bb0ee163dc0c4237aaa4e2efb85878fc. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 14:59:11.703747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Getting quotas for user 479781403bb94b9788fd589f838fea3f and project bb0ee163dc0c4237aaa4e2efb85878fc. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 14:59:11.716839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Going to run 1 instances... {{(pid=129908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 14:59:11.720091 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d4f9926c-33bd-4c90-9ccf-897330beb672',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 14:59:11.790020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:11.790791 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:11.797591 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.797849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.798620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.799076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.870763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:11.879901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e07c37d3-e5a4-45c0-aa2f-a6ec73780ba7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1245 microversion: 2.1 time: 0.093830 May 25 14:59:11.881163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 248/514] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:11 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:11.885846 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-b831960c-96e1-47c8-a91c-3a269f47a37e req-72703f86-456d-450d-a47c-05210e814932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "name": "network-vif-plugged", "status": "completed", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:11.891404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-11cfb6f4-9c0d-471f-908e-40029e78d8a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795531 May 25 14:59:11.897724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 267/515] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 14:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 14:59:11.897906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-b831960c-96e1-47c8-a91c-3a269f47a37e req-72703f86-456d-450d-a47c-05210e814932 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:11.897906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-b831960c-96e1-47c8-a91c-3a269f47a37e req-72703f86-456d-450d-a47c-05210e814932 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:11.903247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9161f17c-b244-48e8-b933-fd0389bff1a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:11.903874 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9161f17c-b244-48e8-b933-fd0389bff1a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:11.912494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-b831960c-96e1-47c8-a91c-3a269f47a37e req-72703f86-456d-450d-a47c-05210e814932 service nova] Creating event network-vif-plugged:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 14:59:11.928198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-b831960c-96e1-47c8-a91c-3a269f47a37e req-72703f86-456d-450d-a47c-05210e814932 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045738 May 25 14:59:11.928879 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 249/516] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:12.001110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9161f17c-b244-48e8-b933-fd0389bff1a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.012023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9161f17c-b244-48e8-b933-fd0389bff1a2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1258 microversion: 2.1 time: 0.112699 May 25 14:59:12.014590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 268/517] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:11 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1258 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:12.057863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1656b40f-7531-4aae-86cf-de8c66c094e7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:12.065892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1656b40f-7531-4aae-86cf-de8c66c094e7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.066338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1656b40f-7531-4aae-86cf-de8c66c094e7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.127913 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1656b40f-7531-4aae-86cf-de8c66c094e7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Going to try to stop instance {{(pid=129907) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 14:59:12.153391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:12.418472 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1656b40f-7531-4aae-86cf-de8c66c094e7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.364841 May 25 14:59:12.419153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 250/518] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 14:59:12 2022] POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 14:59:12.427964 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:12.428586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:12.434870 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.435263 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.436053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.436496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.578764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.586892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-05c9c8f9-6863-47a2-bfba-83d33225e717 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.163342 May 25 14:59:12.587464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 269/519] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:12 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:12.655194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:12.655924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:12.663201 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.676298 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.676298 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.676298 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.803126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.813142 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.814730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.816574 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4ad2142d-aa58-4a4b-8d39-edea423f272e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.165225 May 25 14:59:12.817133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 251/520] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:12 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:12.897356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:12.898068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:12.904571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.905099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.906003 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:12.906320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:12.967888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:12.986574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-048d2dff-b6e9-4c1c-a2fc-088f6777b632 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1245 microversion: 2.1 time: 0.092620 May 25 14:59:12.987602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 270/521] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:12 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:13.031018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-32e60e91-7928-4d04-ab23-79418d3bb6c6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:13.031727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-32e60e91-7928-4d04-ab23-79418d3bb6c6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:13.091521 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-32e60e91-7928-4d04-ab23-79418d3bb6c6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:13.111488 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-32e60e91-7928-4d04-ab23-79418d3bb6c6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1258 microversion: 2.1 time: 0.083200 May 25 14:59:13.112111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 252/522] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:13 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:13.605175 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:13.605950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:13.612414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.612954 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.613738 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.614177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.745466 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:13.754123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e636cde6-046c-4c2e-8e9e-98c006b0aa11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.152783 May 25 14:59:13.754705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 271/523] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:13 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:13.835510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:13.836083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:13.856821 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.857186 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.857971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:13.858409 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:13.992730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:14.000835 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:14.002358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:14.003388 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:14.003852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3ed721a0-356d-4218-bf95-cdb29ffa5241 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1744 microversion: 2.20 time: 0.172041 May 25 14:59:14.004006 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:14.004099 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 253/524] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:13 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:14.010160 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.013185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.013185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.013185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.078457 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:14.087213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-acfa8264-e530-423d-a6e2-ffc537c1ba11 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1301 microversion: 2.1 time: 0.087690 May 25 14:59:14.088156 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 272/525] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:13 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:14.129479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:14.130161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:14.138012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.138514 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.139483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.139930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.205354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:14.219860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d8d14a65-cef0-4d13-bdf7-03ffaa5da4a7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1254 microversion: 2.1 time: 0.095082 May 25 14:59:14.221876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 254/526] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:14 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1254 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:14.776588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:14.777179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:14.784876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.785318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.786098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:14.786538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:14.995372 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.004209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:15.010221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e093ef49-cde9-423a-9760-70366c0d6598 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.241817 May 25 14:59:15.013716 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 273/527] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:14 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:15.021818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:15.022433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:15.038283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.038283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.038283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.038283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.105210 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:15.106042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:15.123602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.124082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.125149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.125591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.670865 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.680113 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.691718 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.693270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-19b5ac86-321f-4dc6-9f22-e9a72e799ee9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.675513 May 25 14:59:15.693999 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 255/528] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:15 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:15.700810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:15.703604 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:15.712379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.723793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-46d7ac01-0e2e-441a-b139-fdcf8d0d41ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.623181 May 25 14:59:15.736966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 274/529] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:15 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:15.740359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.744740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.759326 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:15.761099 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:15.839330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:15.848461 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d14a62fc-107c-40ff-8a91-6778aa3b9317 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1316 microversion: 2.1 time: 0.153080 May 25 14:59:15.849657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 256/530] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:15 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:16.033240 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:16.033240 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:16.076880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.079619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.080499 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.087544 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.565579 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-e251ee0d-0e72-4423-b532-1e2d43bb4b00 req-9bc94dc9-74e3-4432-9046-f4544edb95fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e", "tag": "4611b1ea-e778-46d6-8c99-04a8f2928cb5"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:16.577475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e251ee0d-0e72-4423-b532-1e2d43bb4b00 req-9bc94dc9-74e3-4432-9046-f4544edb95fa service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.577830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e251ee0d-0e72-4423-b532-1e2d43bb4b00 req-9bc94dc9-74e3-4432-9046-f4544edb95fa service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.621556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-e251ee0d-0e72-4423-b532-1e2d43bb4b00 req-9bc94dc9-74e3-4432-9046-f4544edb95fa service nova] Creating event network-changed:4611b1ea-e778-46d6-8c99-04a8f2928cb5 for instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e on hv-cinder-83028 May 25 14:59:16.642730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-e251ee0d-0e72-4423-b532-1e2d43bb4b00 req-9bc94dc9-74e3-4432-9046-f4544edb95fa service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081296 May 25 14:59:16.644570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 257/531] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:16.654210 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:16.665849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d6baf6f5-a0b0-4237-9fc8-322850e98ccb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.639685 May 25 14:59:16.667041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 275/532] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:16 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:16.730212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:16.731581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:16.743701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:16.744613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:16.764479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.770751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.771711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.776128 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.777192 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.778068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:16.778508 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:16.783352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.206123 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:17.625974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.639557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e07fce22-ee34-4277-aa4b-896e0ee94d1a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.899437 May 25 14:59:17.650289 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 276/533] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:16 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:17.654238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.656148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:17.656953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:17.665277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.665946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.666926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.667521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.669132 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.674214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.678887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-846d4527-2c7d-4efe-8c59-371b212a0677 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.959478 May 25 14:59:17.687575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 258/534] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:16 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:17.698082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:17.700009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:17.716586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.717319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.718274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:17.718750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:17.912814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.925932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d9b94dda-92fd-4100-ba7d-a3777e3dd1cc tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.274005 May 25 14:59:17.935320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 277/535] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:17 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:17.948711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:17.960829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cf47e831-7cd8-4dcf-b6c1-467ba0e18e72 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.271392 May 25 14:59:17.962204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 259/536] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:17 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:18.657676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:18.658316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:18.666122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.666570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.667421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.668052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.698669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:18.699367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:18.706715 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.707852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.707999 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.708431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.874204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:18.882674 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e50db8a8-3ae8-4ab7-a86b-b0082b5b8b62 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.229072 May 25 14:59:18.883288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 278/537] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:18 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:18.897677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:18.905710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:18.907256 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:18.908469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a01c271a-d109-4e86-9ca9-abc27258947f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.213686 May 25 14:59:18.908975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 260/538] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:18 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:18.943590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:18.944102 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:18.949999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.954244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.954244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:18.954244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:18.986182 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:18.986182 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:18.997855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.000340 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.000477 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.007038 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.162450 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:19.171749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a2cae364-37a4-428c-8361-c9b5ab0b5fee tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.232631 May 25 14:59:19.182386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 279/539] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:18 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:19.196791 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:19.206667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d0bc3d3a-83ff-4e3b-857d-be066bd8c88e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.231836 May 25 14:59:19.216538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 261/540] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:18 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:19.901133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:19.901666 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:19.903541 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:19.909342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.910058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.911406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.911840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.928858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:19.929663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:19.938431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.939374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:19.940312 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:19.940852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.126474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.130755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.137541 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-851610f9-cb1a-4fc2-884f-14c1e3291c4f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.240595 May 25 14:59:20.149627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.149627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.149627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-91f66cce-2639-4c16-b7a0-562faaf48c60 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.219840 May 25 14:59:20.152434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 280/541] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:19 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:20.154960 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 262/542] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:19 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:20.190678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:20.195794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:20.213969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:20.213969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.213969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:20.213969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.224672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:20.225822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:20.233975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:20.234705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.236025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:20.236618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:20.416309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.425453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ea45fae4-6839-4641-9cf1-8384f68eabce tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.239914 May 25 14:59:20.435231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 281/543] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:20 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:20.466139 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:20.474978 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cc90f63f-f5b8-4c8e-8203-68ba3ba75536 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.254619 May 25 14:59:20.484931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 263/544] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:20 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:21.163356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:21.165369 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:21.167456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:21.168080 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:21.175905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:21.178297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.178885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.179356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.180075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.180705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.181317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.181627 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.182333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.406320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.415456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-72b8274f-d448-4d08-a494-8a803f211a3d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.261866 May 25 14:59:21.416756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 282/545] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:21 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:21.420754 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.430229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.431871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.433525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cfe7901a-77c5-403b-8c46-0cf815d79bfe tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.274689 May 25 14:59:21.442906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 264/546] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:21 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:21.445669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:21.446215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:21.464826 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.465400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.466357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.466849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.494203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:21.494203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:21.499631 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.501903 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.501903 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:21.501903 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:21.688111 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:21.711704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.719756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-601576ba-d218-435d-9958-321144858de3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.278001 May 25 14:59:21.720531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 283/547] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:21 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:21.732046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:21.740090 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ec834569-6916-4f03-b4a6-b32e58372aa9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.251703 May 25 14:59:21.740657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 265/548] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:21 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:22.435397 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:22.435800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:22.437774 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=16 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:22.442935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.443497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.444540 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.445081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.453196 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:22.453762 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:22.461190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.461658 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.462470 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.468502 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.725348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:22.729149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:22.740786 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:22.741905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4b1cddb3-58db-4bc8-826b-0b76ef93de9d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.311728 May 25 14:59:22.742308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:22.743968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d424f3be-375f-464d-87b4-1f4fa068a22e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.294428 May 25 14:59:22.747270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 284/549] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:22 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:22.755619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 266/550] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:22 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:22.760108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:22.760729 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:22.765246 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:22.766005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:22.767296 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.767763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.769001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.769433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.772952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.773722 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.774422 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:22.775043 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:22.992167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:23.000932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-10cecf58-1ee5-49a0-b8e0-5259b3bc2607 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.252008 May 25 14:59:23.001522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 285/551] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:22 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:23.046613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:23.055708 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1fdb0c12-2ece-4c3f-94cc-118ff621248d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.294155 May 25 14:59:23.065717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 267/552] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:22 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:23.773403 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:23.779107 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:23.780258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:23.781146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:23.796718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:23.798964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=16 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:23.801735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:23.806177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:23.807982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:23.808576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:23.813805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:23.815000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:23.815666 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:24.170065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:24.170065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:24.170307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:24.170410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:24.170410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3454c1b5-7d44-4ae7-818b-4ffe11801c2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.397326 May 25 14:59:24.170410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 286/553] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:23 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:24.170656 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:24.170656 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ebdfba12-f162-4e63-918f-cccdc414cfae tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.405725 May 25 14:59:24.170814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:24.170895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 268/554] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:23 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:24.170978 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:24.175651 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:24.176736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:24.177173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:24.177635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:24.178430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:24.178896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:24.187079 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:24.193325 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:24.194765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:24.195544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:24.451352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:24.453311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:24.461467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f05b695d-02e3-4de6-aba8-860fe012cc72 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.296694 May 25 14:59:24.462049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 287/555] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:24 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:24.462522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ebef41c9-b4fe-4d34-9d53-919242426f54 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.292541 May 25 14:59:24.463162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 269/556] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:24 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:25.196276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:25.197102 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:25.214567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:25.215965 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:25.218749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.219355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.220231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.220746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.238051 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.238543 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.239516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.239862 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.502456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.508093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.512045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d9b47c3f-afa1-43d6-8708-387afd3229f6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.320756 May 25 14:59:25.521473 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 288/557] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:25 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:25.521473 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:25.521473 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:25.528213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.528802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.529767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.530199 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.530365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.532223 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.535093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-959ac3a0-62c3-499d-b061-df13e42ac378 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.325075 May 25 14:59:25.535888 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 270/558] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:25 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:25.541075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:25.541966 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:25.550678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.551548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.552533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:25.554014 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:25.775324 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.782850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0f2af0d4-69fb-4a40-971d-673af01d8169 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.269181 May 25 14:59:25.783419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 289/559] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:25 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:25.789137 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:25.797190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-281028e2-5cd3-423f-8b9f-117f54e5717c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.260147 May 25 14:59:25.797749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 271/560] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:25 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:26.529653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:26.530489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:26.537161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.537820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.538619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.539083 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.559051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:26.603281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:26.604612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:26.619179 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.620035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.622589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.622589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.777605 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:26.787413 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-36c599d1-87eb-4690-970a-816b5e53aade tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.261935 May 25 14:59:26.797768 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 290/561] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:26 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:26.810347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:26.819321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:26.828726 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.829199 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.830101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.832616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.861750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:26.870540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:26.872194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:26.873498 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4fcab3b4-d688-4fd9-bd14-4bb1e3cf4f70 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.274204 May 25 14:59:26.874049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 272/562] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:26 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:26.879448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:26.880127 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:26.886986 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.887430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:26.888203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:26.888630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.005277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:27.012857 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-38e765a1-380c-4b97-a750-0627551076ca tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.208924 May 25 14:59:27.013432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 291/563] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:26 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:27.046512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:27.054950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a6d52077-0266-4c0c-a126-c64e24756df5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.179895 May 25 14:59:27.055509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 273/564] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:26 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:27.804454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:27.805204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:27.811740 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:27.812192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.812978 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:27.813415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.893921 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:27.894531 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:27.906166 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:27.906854 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.907637 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:27.908083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:27.997024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.004507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2a392b03-0fb6-4da1-bddb-bea963883a15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.203915 May 25 14:59:28.005081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 292/565] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:27 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:28.029229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:28.029903 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:28.036348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:28.036798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:28.037575 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:28.038010 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:28.057098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.065721 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.067267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.068420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-92d87ebe-5028-4a6b-a00f-a2fd58989ef2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.179167 May 25 14:59:28.068974 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 274/566] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:27 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:28.073284 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:28.073880 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:28.079817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:28.080271 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:28.081618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:28.082060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:28.213266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.220938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-910b1a9a-49b1-4ecc-b614-1d33e7435843 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.195474 May 25 14:59:28.221601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 293/567] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:28 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:28.245890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:28.254373 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-81d792bc-1e1a-4b6f-bbbe-92b54b540d48 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.184473 May 25 14:59:28.254967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 275/568] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:28 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:29.021976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:29.022577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:29.028688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.029135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.029900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.030333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.087869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:29.089039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:29.096303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.097063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.098180 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.098804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.205073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.220630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-070f74bc-664b-438f-a99d-a3568e8837b0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.202164 May 25 14:59:29.221807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 294/569] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:29 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:29.239648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:29.240267 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:29.247051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.247761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.248709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.249574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.281942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.290772 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.292347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.293532 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2c281435-8871-47dc-95d5-6942a11aff42 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.209620 May 25 14:59:29.294198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 276/570] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:29 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:29.302765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:29.303607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:29.318253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.318892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.319854 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:29.320396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:29.465085 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.484692 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bd5f9eb3-8b26-4985-b754-fe0035483fef tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.249511 May 25 14:59:29.485924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 295/571] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:29 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:29.500004 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:29.510888 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-08982dbb-01f7-4403-8de6-d50ecb6ce191 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.215387 May 25 14:59:29.511758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 277/572] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:29 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:30.237349 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:30.237970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:30.243946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.244390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.245140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.245576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.312773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:30.313385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:30.321103 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.321548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.322327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.322785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.407482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.415960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b43e5b30-a733-4e76-91db-90a7a9fa70c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.182517 May 25 14:59:30.416530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 296/573] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:30 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:30.469757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.477780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.479347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.480501 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-44643a99-ca35-43e8-a3b3-e31a3a086f32 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.171958 May 25 14:59:30.481061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 278/574] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:30 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:30.501080 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:30.501699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:30.508180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.508634 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.509403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.509842 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.528108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:30.528719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:30.534624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.535103 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.535865 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:30.536299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:30.714107 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.718505 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:30.726962 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a3f93db7-dc9b-4a8f-857d-1804f4eeb760 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.202458 May 25 14:59:30.727184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f3aa2435-0a89-4f6a-b52c-fb2e13f33881 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.225583 May 25 14:59:30.727541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 279/575] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:30 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:30.728260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 297/576] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:30 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:31.432746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:31.433282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:31.440730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.441178 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.441938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.442372 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.497693 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:31.498321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:31.504405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.504859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.505627 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.506061 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.631636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:31.639718 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2f5cf777-de5c-4404-a6ac-1bb1d08ee979 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.210791 May 25 14:59:31.640594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 280/577] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:31 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:31.677229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:31.685834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:31.687588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:31.688766 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-54e53556-dde0-45e4-987c-edb863c12d00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.194998 May 25 14:59:31.689357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 298/578] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:31 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:31.744209 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:31.744823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:31.744977 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:31.746312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:31.751621 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.752075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.752972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.753440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.755501 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.755964 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.756754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:31.757270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:31.992714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.001427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dd907cf9-2f1d-4c61-8fda-ebf286ab949e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.260298 May 25 14:59:32.002326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 299/579] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:31 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:32.004808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.013414 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b2e53805-7a03-4851-a38f-9d5db7eb074c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.273052 May 25 14:59:32.014675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 281/580] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:31 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:32.656976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:32.657545 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:32.664122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.664574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.665345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.665783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.714855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:32.715562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:32.724465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.724927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.725721 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:32.726338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:32.886403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.894483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-54440b0b-f0df-4638-80b9-5d627499dbde tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.241412 May 25 14:59:32.895356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 300/581] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:32 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:32.918191 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.927910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.929863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:32.931126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d83cbdfd-4cdb-4a69-8516-a8e5fc21f835 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.227636 May 25 14:59:32.942882 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 282/582] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:32 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:33.018926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:33.020131 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:33.025751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.026288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.027108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.027561 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.031155 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:33.031876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:33.038375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.038857 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.039615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.040045 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.239201 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:33.246482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3fa9fe21-5532-4751-9876-e233e6e70b44 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.232013 May 25 14:59:33.246671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:33.247114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 301/583] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:33 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:33.254684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-70bd1b39-64bb-48d1-836a-8e204e168740 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.227391 May 25 14:59:33.255375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 283/584] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:33 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:33.912172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:33.912814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:33.918975 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.919420 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.920198 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.920652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.949533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:33.952096 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:33.959383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.960175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:33.961668 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:33.962335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:34.137481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.146819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-46deb79d-243c-4dc6-ba89-7e47d8e8799f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.238587 May 25 14:59:34.147946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 302/585] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:33 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:34.166555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.181379 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.183223 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.184689 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-66651891-be7b-49b0-bd45-e76212a5a02a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.239180 May 25 14:59:34.185251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 284/586] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:33 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:34.263599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:34.264226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:34.270334 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:34.270823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:34.271375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:34.271591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:34.271994 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:34.272109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:34.278094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:34.278549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:34.279676 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:34.280129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:34.326558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:34.713599 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.722276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2bd4b3f7-1d84-4440-a21d-73c0adee6d18 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.453964 May 25 14:59:34.729535 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 285/587] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:34 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:34.756678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:34.764077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dbcf62d2-57ff-4f65-82ad-cb60913a5be7 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.504314 May 25 14:59:34.764633 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 303/588] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:34 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:35.165135 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:35.165756 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:35.173029 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.178943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.178943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.178943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.203749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:35.207698 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:35.211059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.211506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.212277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.212706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.359362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.367802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-54459c1e-68f4-4949-bf31-caa1fa38eda4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.206892 May 25 14:59:35.368296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 286/589] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:35 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:35.386477 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.395822 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.397322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.398484 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e44cdcee-1967-4b37-b032-26b6a28b88c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.198702 May 25 14:59:35.399078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 304/590] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:35 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:35.740313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:35.740931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:35.746940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.747388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.748153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.748592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.781011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:35.781616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:35.788265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.788709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.789484 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:35.790132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:35.960494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:35.960494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ec3f84e3-7423-462e-81ff-6e17d1b3231e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.222919 May 25 14:59:35.960494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 287/591] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:35 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:36.014710 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.023096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-864469c4-1e17-457b-8828-c117a93c8020 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.245771 May 25 14:59:36.023665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 305/592] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:35 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:36.384209 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:36.384820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:36.391438 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.391872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.392639 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.393125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.417209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:36.417954 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:36.424639 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.425346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.426570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.427269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.719500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.729239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f917c7fb-f1dc-4697-bb87-b266a59b777f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.348237 May 25 14:59:36.729239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 288/593] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:36 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:36.739962 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.748367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.762973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:36.762973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-143739a3-dee1-49ab-b789-a7f3406b4456 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1739 microversion: 2.20 time: 0.338365 May 25 14:59:36.762973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 306/594] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:36 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:36.953696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-9361966b-01d4-4678-aefa-8d4fe40c7884 req-498657ff-1c41-4003-84b9-4d80a0d71bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:36.962392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-9361966b-01d4-4678-aefa-8d4fe40c7884 req-498657ff-1c41-4003-84b9-4d80a0d71bcf service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.962882 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-9361966b-01d4-4678-aefa-8d4fe40c7884 req-498657ff-1c41-4003-84b9-4d80a0d71bcf service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.977555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:36.978479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:36.981686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-9361966b-01d4-4678-aefa-8d4fe40c7884 req-498657ff-1c41-4003-84b9-4d80a0d71bcf service nova] Creating event network-changed:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 14:59:36.985686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.986142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.986992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:36.987588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:36.992104 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:36.994486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-9361966b-01d4-4678-aefa-8d4fe40c7884 req-498657ff-1c41-4003-84b9-4d80a0d71bcf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044448 May 25 14:59:36.995136 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 289/595] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:37.041407 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:37.042195 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:37.049260 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.049808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.050705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.051249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.189441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.202004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4f673926-ae54-4407-bf46-cd1736ee4ad4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.228276 May 25 14:59:37.203145 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 307/596] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:36 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:37.300889 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.308335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-efa1b50f-5a02-4ce6-a0a2-0ec71b0a0e93 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.271516 May 25 14:59:37.308898 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 290/597] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:37 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:37.745553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:37.746169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:37.752204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.752651 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.753405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.753835 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.769834 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:37.770545 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:37.777106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.777559 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.778367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:37.778833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:37.949969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.957581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.958031 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-07c400a3-7bb8-4ccb-8317-a46fef923e8c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.216448 May 25 14:59:37.958608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 308/598] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:37 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:37.965565 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.967140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:37.968405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-390a3f04-4b16-4605-9549-36efada1820b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.203105 May 25 14:59:37.968978 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 291/599] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:37 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:38.219845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:38.220463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:38.226597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.227083 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.227849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.228285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.329269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:38.329881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:38.336110 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.336566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.337339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.337778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.368878 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:38.390137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2a3b5882-5f3b-4783-a4be-3c6d9b8e0c80 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.174074 May 25 14:59:38.391013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 309/600] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:38 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:38.481161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:38.489055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3d56ec34-f5f5-4564-b795-d66a7c3395a0 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.163553 May 25 14:59:38.489618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 292/601] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:38 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:38.974473 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:38.975118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:38.982434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.982861 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.983755 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.984218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.987138 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:38.987784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:38.994217 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.994696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:38.995472 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:38.995967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.181714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.185014 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.189669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-46fd2d8e-42e2-4619-8d57-3f4cd16b92db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.219037 May 25 14:59:39.190282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 310/602] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:38 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:39.193402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.197702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.197702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1d0a2e2c-7d5b-4804-8a75-6f341dfeca0e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.213234 May 25 14:59:39.197702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 293/603] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:38 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:39.407814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:39.408456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:39.414439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.414913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.415738 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.416115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.511462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:39.512253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:39.518594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.519625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.520401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:39.520835 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:39.548823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.557512 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1973784e-d300-4d5c-a74d-db777a96af19 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.153527 May 25 14:59:39.558090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 311/604] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:39 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:39.649572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:39.656940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6ba98412-d109-4b91-a8e8-8b05b38a852f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.154895 May 25 14:59:39.657505 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 294/605] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:39 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:40.212629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:40.213305 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:40.214617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:40.215423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:40.219319 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.219766 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.220537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.220972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.221829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.222286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.223083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.223516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.413083 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.417061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.420744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b8b584c4-93fe-4099-a6ec-c6e1cf84fe3f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.211952 May 25 14:59:40.421319 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 312/606] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:40 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:40.425546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.427144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.428289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2ad0269a-d11d-4a39-b310-d4091244164d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.217763 May 25 14:59:40.428827 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 295/607] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:40 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:40.575076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:40.575695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:40.581716 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.582161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.582961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.583396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.679143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:40.679759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:40.685816 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.686532 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.687332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:40.687766 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:40.709730 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.719808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5f6ae9ec-ab78-4ac0-8306-e06dfdd61ddf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.148413 May 25 14:59:40.720534 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 313/608] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:40 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:40.814959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:40.822400 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c58f41c3-3cf9-4766-b9f9-844094ec1963 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.151853 May 25 14:59:40.822987 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 296/609] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:40 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:41.438310 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:41.439037 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:41.445597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.446039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.446831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.447052 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:41.447495 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.447650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:41.454299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.454777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.456060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.456489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.635414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.643345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-90bea10d-c337-47b7-ac24-37da2ce5e276 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.209140 May 25 14:59:41.644231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 314/610] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:41 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:41.649797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.657879 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.659909 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.661051 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0a0ebfb3-b697-4e98-b144-cec6c235e5d9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.218007 May 25 14:59:41.661601 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 297/611] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:41 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:41.736638 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:41.737879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:41.743936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.744382 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.745139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.745569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.844185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:41.844561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:41.855517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.856331 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.857723 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:41.858515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:41.902187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:41.911057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d5005ee3-ebd8-401a-adfe-3a466f96eeec tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.178344 May 25 14:59:41.911632 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 315/612] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:41 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:42.009285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.016818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ae6e3307-c570-4de6-83d5-721d7fc1278a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.180872 May 25 14:59:42.017380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 298/613] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:41 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:42.661520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:42.662062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:42.668359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.668804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.669565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.669999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.679425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:42.680727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:42.687925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.688376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.689148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.689584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.864420 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.873012 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-673b22e9-7541-46da-9892-616e0047ed12 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.215663 May 25 14:59:42.874993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 316/614] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:42 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:42.876060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.884478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.885993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:42.891124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0ba410fa-b43c-41d6-924e-ce59957dc3d0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.212012 May 25 14:59:42.891124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 299/615] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:42 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:42.933325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:42.933887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:42.940364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.940799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:42.941567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:42.942002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.033958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:43.034605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:43.040759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.041244 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.042023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.042489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.070924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:43.079215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f8e5ddcf-cc60-48db-acf7-dcb42a1d69bd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.149866 May 25 14:59:43.079798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 317/616] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:42 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:43.169590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:43.177132 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-df2c55ce-26a1-451d-898e-72827e18bb62 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.147560 May 25 14:59:43.177693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 300/617] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:43 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:43.641044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-cd7df6d6-dfbe-4b8b-9da3-a869df384761 req-3dda7d2e-4f5e-416d-a2ba-123625af8c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "name": "network-vif-unplugged", "status": "completed", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:43.651485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-cd7df6d6-dfbe-4b8b-9da3-a869df384761 req-3dda7d2e-4f5e-416d-a2ba-123625af8c09 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.651919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-cd7df6d6-dfbe-4b8b-9da3-a869df384761 req-3dda7d2e-4f5e-416d-a2ba-123625af8c09 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.663513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-cd7df6d6-dfbe-4b8b-9da3-a869df384761 req-3dda7d2e-4f5e-416d-a2ba-123625af8c09 service nova] Creating event network-vif-unplugged:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 14:59:43.668603 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-cd7df6d6-dfbe-4b8b-9da3-a869df384761 req-3dda7d2e-4f5e-416d-a2ba-123625af8c09 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031516 May 25 14:59:43.669181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 318/618] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:43.888967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:43.889571 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:43.896900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.897348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.898150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.898670 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.908494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:43.909253 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:43.916933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.917442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:43.918170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:43.918695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.098048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.105385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-23f60992-1cb9-476f-9830-c805211683fc tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.220201 May 25 14:59:44.112528 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 301/619] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:43 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:44.112803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.112916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:44.112916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:44.117511 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:44.118151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.118932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:44.119377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.119707 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.121229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.122390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-485f9619-f4c2-4f2a-8e69-36927c932336 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.218271 May 25 14:59:44.122972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 319/620] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:43 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:44.193688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:44.194357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:44.207823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:44.208277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.209078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:44.209517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:44.290552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.294046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.299414 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-09391e7d-7e4e-4b26-83f9-b563ec159edd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1721 microversion: 2.1 time: 0.192362 May 25 14:59:44.300492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 302/621] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:44 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:44.360036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:44.367588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e46cb518-3858-414b-b77f-f5c1435b9c34 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.178061 May 25 14:59:44.368095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 320/622] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:44 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:45.095281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 14:59:45.096234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 14:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 14:59:45.140997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:45.141624 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:45.147924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.148380 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.149408 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.150042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.246123 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:45.247526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:45.255185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.255644 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.256616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.257294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.387591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.396079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.398220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.399430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-494c5952-3fc8-4572-a97b-cceb1110e6e0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.262625 May 25 14:59:45.400203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 321/623] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:45 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:45.404914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:45.405528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:45.412278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.412737 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.413527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.413970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.431261 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.440947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9bd36777-cfbc-4df0-a797-a41bebb2718b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.321256 May 25 14:59:45.441622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 303/624] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:45 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:45.446659 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:45.447269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:45.453809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.454265 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.455730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.456176 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.593754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.602990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-00ddc77e-4128-4bb0-8ea0-e10ada5d7e30 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1698 microversion: 2.1 time: 0.201523 May 25 14:59:45.603898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 322/625] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:45 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:45.620080 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b217d88c-7bb3-46fb-9bd7-82711e4c170b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:45.626970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:45.632686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b217d88c-7bb3-46fb-9bd7-82711e4c170b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.633135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b217d88c-7bb3-46fb-9bd7-82711e4c170b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.634048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-08b53045-f68f-4954-94ff-ab69d2647764 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.191205 May 25 14:59:45.634769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 304/626] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:45 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:45.695569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b217d88c-7bb3-46fb-9bd7-82711e4c170b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Going to try to start instance {{(pid=129908) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 14:59:45.721482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:45.884931 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b217d88c-7bb3-46fb-9bd7-82711e4c170b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.268317 May 25 14:59:45.885329 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 323/627] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 14:59:45 2022] POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 14:59:45.894067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:45.894701 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:45.900745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.901192 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:45.901956 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:45.902391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.035369 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:46.044203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e002b317-e4eb-4938-bce3-7167c416ecc9 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.154563 May 25 14:59:46.044845 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 305/628] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:45 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:46.418030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:46.425474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:46.425664 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.426126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.426925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.427370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.459337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:46.460163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:46.467491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.468083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.468938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.469491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.616496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:46.624803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:46.626331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:46.627589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e3b839c9-ad16-46ba-9c8e-aec672d59830 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.213846 May 25 14:59:46.628147 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 324/629] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:46 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:46.647825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:46.650346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:46.651120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:46.655497 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-736acffb-0e31-4e6b-8434-9c622a7920d1 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.201795 May 25 14:59:46.656242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 306/630] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:46 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:46.657331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.657788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.659242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:46.659683 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:46.788185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:46.795527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ea6aca16-ae7d-4482-9d15-70eab2f6e6ff tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.148991 May 25 14:59:46.796083 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 325/631] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:46 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:47.062229 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:47.062915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:47.069744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.070240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.071063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.071505 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.201896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:47.210616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1b5f6d6a-d981-43ff-ab13-1bc8a51a01c2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.152596 May 25 14:59:47.212124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 307/632] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:47 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:47.646428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:47.647010 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:47.652886 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.653328 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.654079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.654514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.673061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:47.673671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:47.681240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.681746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.682760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.683184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.839927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:47.848294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:47.850297 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:47.851143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2be9f2dd-eec7-4181-9139-e7d2a7dafc0b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.208728 May 25 14:59:47.853266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 326/633] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:47 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:47.857271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:47.857882 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:47.864409 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.865026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.865793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:47.866395 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:47.874013 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:47.889959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-11e2f384-870c-4c36-abab-62cf1a2accee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.213753 May 25 14:59:47.889959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 308/634] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:47 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:47.997497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:48.006250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f6d41ac8-e2bc-45a7-bb0b-da2b4fd053e9 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.152806 May 25 14:59:48.007356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 327/635] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:47 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:48.072446 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-88e3a614-def2-424b-92b9-ae05af94338c req-f22061cc-005f-4e2c-8bab-70722c57301f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e", "name": "network-vif-plugged", "status": "completed", "tag": "4611b1ea-e778-46d6-8c99-04a8f2928cb5"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:48.080648 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-88e3a614-def2-424b-92b9-ae05af94338c req-f22061cc-005f-4e2c-8bab-70722c57301f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.081162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-88e3a614-def2-424b-92b9-ae05af94338c req-f22061cc-005f-4e2c-8bab-70722c57301f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.091817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-88e3a614-def2-424b-92b9-ae05af94338c req-f22061cc-005f-4e2c-8bab-70722c57301f service nova] Creating event network-vif-plugged:4611b1ea-e778-46d6-8c99-04a8f2928cb5 for instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e on hv-cinder-83028 May 25 14:59:48.097410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-88e3a614-def2-424b-92b9-ae05af94338c req-f22061cc-005f-4e2c-8bab-70722c57301f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028720 May 25 14:59:48.098017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 309/636] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:48.229898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:48.230515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:48.237253 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.238181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.238460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.238997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.368114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:48.376125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6957de87-9627-4403-9352-2b90eda6fd10 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.150205 May 25 14:59:48.376685 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 328/637] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:48 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:48.871126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:48.871819 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:48.878550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.879549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.879817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.880246 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.901297 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:48.901914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:48.910873 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.911321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:48.912097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:48.912532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.070384 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.081050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.082728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.084075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fca0673e-611c-4a75-bd2f-03d239f41fce tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1721 microversion: 2.20 time: 0.218000 May 25 14:59:49.084728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 310/638] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:48 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:49.089465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:49.090063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:49.097270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:49.097730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.098499 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:49.098959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.105646 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.112148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fe0f6984-16d0-4fcd-8c26-a532cedcf081 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.214585 May 25 14:59:49.112905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 329/639] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:48 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:49.240190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.247818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-da592785-197a-49f5-9674-3914f29f51eb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.161986 May 25 14:59:49.248389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 311/640] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:49 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:49.393900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:49.394504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:49.396524 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:49.401259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:49.401731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.402492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:49.402953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:49.566009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:49.574072 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-889f8dae-0b87-4f1e-a40c-3d4087823b9b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.184660 May 25 14:59:49.574662 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 330/641] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:49 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:50.130305 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:50.131837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:50.139884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.141844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.145139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.146865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.361984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.369743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-27c7d153-86f4-4d7e-a1fb-c6963e4a087d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.244275 May 25 14:59:50.370308 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 331/642] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:50 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:50.375040 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:50.375851 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:50.383714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.383869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:50.384354 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.384479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:50.384998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.385433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.390524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.396376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.396376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.396376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.634064 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.638513 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.642600 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c15bfe6a-b1d6-4c1a-bfc1-31045d5dc666 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.271002 May 25 14:59:50.643186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 332/643] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:50 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:50.646906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.647737 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:50.648339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:50.648467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.649721 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d0c8d7d6-d2d6-45a9-9cbc-3122a895e3cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1724 microversion: 2.20 time: 0.550878 May 25 14:59:50.655802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.656285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.658553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.658553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.659503 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 312/644] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:50 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:50.669765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f52a1b6-f703-4aa6-b783-8d846a76ddef"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:50.671067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:50.679068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.680175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.680971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:50.681419 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:50.822379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:50.831449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2172b35d-6eb4-459f-97e5-e34e76a1f88b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.187250 May 25 14:59:50.832075 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 333/645] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:50 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:51.386674 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:51.387464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:51.393989 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.394435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.395220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.395669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.523781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:51.531428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-58128a57-7c6b-4603-a8ea-61c6e607c40c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.148765 May 25 14:59:51.532032 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 334/646] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:51 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:51.659964 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:51.660904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:51.667211 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.671281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.671281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.671281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.847088 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-bcf53dfd-0405-4065-977a-f4b94b53c223 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.181050 May 25 14:59:51.848339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 313/647] 10.222.0.74 () {62 vars in 1363 bytes} [Wed May 25 14:59:50 2022] POST /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments => generated 188 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 14:59:51.854815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:51.855566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:51.857820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=99 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:51.863953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:51.865547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.868422 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.869582 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:51.870092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:51.877487 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8717f96e-3c6d-4e63-9c90-df7812ed77aa tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.221306 May 25 14:59:51.879288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 335/648] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:51 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:52.002350 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:52.008253 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:52.010095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.010615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.011511 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.011992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.024643 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:52.036792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2a43771d-486e-42f7-a502-47803f3caf65 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.186610 May 25 14:59:52.038074 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 314/649] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:51 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:52.257208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-0e71a91d-5687-4c83-9834-e6ba3340dc27 req-807941d6-5773-4f25-af9d-d51f1f96de33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "name": "network-vif-plugged", "status": "completed", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:52.265972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-0e71a91d-5687-4c83-9834-e6ba3340dc27 req-807941d6-5773-4f25-af9d-d51f1f96de33 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.266423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-0e71a91d-5687-4c83-9834-e6ba3340dc27 req-807941d6-5773-4f25-af9d-d51f1f96de33 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.277238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-0e71a91d-5687-4c83-9834-e6ba3340dc27 req-807941d6-5773-4f25-af9d-d51f1f96de33 service nova] Creating event network-vif-plugged:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 14:59:52.282187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-0e71a91d-5687-4c83-9834-e6ba3340dc27 req-807941d6-5773-4f25-af9d-d51f1f96de33 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028790 May 25 14:59:52.282797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 315/650] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:52.431748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-81411975-4980-43f8-a993-bb031b01ba68 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/action" status: 202 len: 0 microversion: 2.20 time: 0.437022 May 25 14:59:52.432965 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 336/651] 10.222.0.74 () {62 vars in 1318 bytes} [Wed May 25 14:59:51 2022] POST /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 14:59:52.442594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:52.443382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:52.449837 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.450307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.451117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.451561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.550019 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:52.550811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:52.557914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.558734 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.559739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.560181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.688810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:52.710187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:52.710406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:52.712162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-686e7344-0804-4b1d-a88c-e8dcda6f7f8d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1750 microversion: 2.20 time: 0.274217 May 25 14:59:52.713459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 316/652] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:52 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1750 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 14:59:52.770257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:52.780266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d33b2217-8f42-43b6-8d99-ec6e9f6c087e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1367 microversion: 2.1 time: 0.235097 May 25 14:59:52.782109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 337/653] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:52 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:52.894845 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:52.895400 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:52.901359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.901807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:52.902558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:52.903017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.044688 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:53.052855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-719a1db1-0698-4448-b114-fc80f06610b8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.162493 May 25 14:59:53.053593 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 317/654] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:52 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:53.054920 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:53.055594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:53.062353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.062826 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.063603 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.065017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.209412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:53.218419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e0eaba1c-a97e-4b5f-8a04-a2c5f0c5f0b1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1707 microversion: 2.1 time: 0.167639 May 25 14:59:53.225350 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 338/655] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:53 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1707 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:53.732835 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:53.733453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:53.740145 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.741108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.742078 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.742940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.747355 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:53.800374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:53.802309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:53.817830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.819270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.820062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:53.820506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:53.824747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:53.938407 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:53.949139 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:53.950686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:53.951869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-11b9c7e7-e354-4d56-a4d1-74b5a55cc7e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1750 microversion: 2.20 time: 0.224232 May 25 14:59:53.952434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 318/656] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:53 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1750 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:54.040793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:54.048630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-05f5b9f0-2c62-4b91-ab10-eac16f2b610b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1556 microversion: 2.1 time: 0.253438 May 25 14:59:54.049238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 339/657] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:53 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:54.065871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:54.067197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:54.069927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:54.070558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:54.072634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.073085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.073851 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.074448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.077005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.077452 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.078230 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.078698 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.185351 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1f66e4dd-8a0f-477d-883d-698918731d3a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124114 May 25 14:59:54.190694 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 319/658] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 14:59:54 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:54.254680 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:54.269465 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-38debced-d723-4a8b-add0-6f47bcc2a714 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.198355 May 25 14:59:54.269465 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 340/659] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:54 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 14:59:54.364278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:54.364924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:54.371840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.372415 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.373171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.373605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.521419 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:54.534947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a41b4207-b46f-42f2-a70f-a537a542b400 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1711 microversion: 2.1 time: 0.298404 May 25 14:59:54.534947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 320/660] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:54 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1711 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:54.972117 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:54.972735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:54.979369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.979820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:54.980592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:54.981030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:55.114244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:55.123386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:55.124958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:55.126165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fbca0722-2075-444f-8a29-b2bbf04721ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1750 microversion: 2.20 time: 0.158438 May 25 14:59:55.126742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 341/661] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:54 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:55.281389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:55.282044 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:55.288780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:55.289232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:55.291635 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:55.291635 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:55.432956 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:55.437889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-ff06dca7-55a9-430b-9abb-c660b0fa34bc req-ac5332fb-63b8-4841-8ae5-f922f11acff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e", "tag": "4611b1ea-e778-46d6-8c99-04a8f2928cb5"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 14:59:55.444487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1dde102b-49ca-4a51-813b-873757e0b223 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1358 microversion: 2.1 time: 0.166511 May 25 14:59:55.445253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 321/662] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:55 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:55.454163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ff06dca7-55a9-430b-9abb-c660b0fa34bc req-ac5332fb-63b8-4841-8ae5-f922f11acff1 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:55.454722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ff06dca7-55a9-430b-9abb-c660b0fa34bc req-ac5332fb-63b8-4841-8ae5-f922f11acff1 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:55.468428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-ff06dca7-55a9-430b-9abb-c660b0fa34bc req-ac5332fb-63b8-4841-8ae5-f922f11acff1 service nova] Creating event network-changed:4611b1ea-e778-46d6-8c99-04a8f2928cb5 for instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e on hv-cinder-83028 May 25 14:59:55.472696 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-ff06dca7-55a9-430b-9abb-c660b0fa34bc req-ac5332fb-63b8-4841-8ae5-f922f11acff1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040601 May 25 14:59:55.473400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 342/663] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 14:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:56.144904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:56.145518 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:56.151793 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.152247 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.153075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.153499 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.322629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.348605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.350125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.351354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ae9c5404-8bd7-4f8f-9cab-c0a52088abc2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1752 microversion: 2.20 time: 0.210908 May 25 14:59:56.352286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 322/664] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:56 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1752 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:56.462490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:56.465565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:56.470316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.470880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.471732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.472264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.611024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.619675 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5544b037-f311-4f7e-b72e-30bb05963969 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1549 microversion: 2.1 time: 0.161404 May 25 14:59:56.620269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 343/665] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:56 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:56.636350 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:56.636963 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:56.650880 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.651337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.652148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.652588 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.864094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.872076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8f801263-ff65-4564-a12b-d7c760a3b2d2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1549 microversion: 2.1 time: 0.239383 May 25 14:59:56.872578 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 323/666] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:56 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:56.888341 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:56.891770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:56.892616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Searching by: {'deleted': False, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc'} {{(pid=129908) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 25 14:59:56.899372 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.899821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.900623 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:56.901062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:56.993854 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.multi_cell_list [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129908) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 25 14:59:57.088939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-afb5b52d-177b-4df0-871f-5772b48da220 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204226 May 25 14:59:57.089538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 344/667] 10.222.0.74 () {58 vars in 1124 bytes} [Wed May 25 14:59:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 14:59:57.100531 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:57.101148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:57.107241 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:57.107692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:57.108458 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:57.108895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:57.244901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:57.249562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-47863cde-db2a-42d4-a925-19cd6ad4a0c5 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1549 microversion: 2.1 time: 0.153050 May 25 14:59:57.250149 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 324/668] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 14:59:57 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 14:59:57.373877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:57.376256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:57.385598 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:57.386044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:57.387183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:57.387628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:57.523563 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:57.531853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:57.533371 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:57.534517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-42879e46-7df9-4caa-86d6-10576bc1a708 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1752 microversion: 2.20 time: 0.168468 May 25 14:59:57.535099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 345/669] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:57 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:58.553775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:58.554704 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:58.561829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:58.562292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:58.563136 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:58.563580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:58.786563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:58.795617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:58.797206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:58.798439 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8a46c300-c105-4b8c-a7a5-64694d075034 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.248752 May 25 14:59:58.799279 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 325/670] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:58 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 14:59:59.818035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 14:59:59.819001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 14:59:59.825865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:59.831316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:59.831316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 14:59:59.831316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 14:59:59.972720 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:59.996190 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:59.997700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 14:59:59.999111 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ed5e0961-1801-49b5-a978-cb782c096dff tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.185163 May 25 14:59:59.999837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 346/671] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 14:59:59 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:00.266616 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5dba9b7-1425-4450-8dc7-862944e50ec5"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:00.267840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:00.274947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:00.275950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:00.276843 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:00.277376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:01.017998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:01.021377 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:01.024764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:01.025211 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:01.025975 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:01.026410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:01.164548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:01.175428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:01.177411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:01.178915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-986abf0d-d332-4c02-a602-06a95068debd tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.165416 May 25 15:00:01.179586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 347/672] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:01 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:02.198333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:02.200023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:02.210467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:02.211163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:02.211956 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:02.212386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:02.376320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:02.387014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:02.388659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:02.390210 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a46523f5-570b-445d-becf-5d178587719b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.196428 May 25 15:00:02.391360 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 348/673] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:02 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:03.420082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:03.420706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:03.427305 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:03.427755 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:03.428537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:03.428975 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:03.589119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:03.599086 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:03.600535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:03.601705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-af72fb8d-9573-432d-84c0-5671190ba923 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.189683 May 25 15:00:03.602271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 349/674] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:03 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:04.620797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:04.621455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:04.628046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:04.628492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:04.629336 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:04.629764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:04.782235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:04.791368 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:04.792877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:04.794045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7b17cf3c-3c0d-4c34-b63b-ad9bdf9694e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.177323 May 25 15:00:04.794606 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 350/675] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:04 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:05.813381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:05.814708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:05.821590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:05.822328 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:05.823385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:05.824004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:05.962040 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:05.971166 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:05.972763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:05.974630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f6940ba7-6901-48a9-adaf-56715f5de6cc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.165392 May 25 15:00:05.975447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 351/676] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:05 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:06.993735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:06.994524 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:06.996772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.001743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:07.002195 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:07.003001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:07.003434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:07.155130 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:07.165623 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:07.167601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:07.169011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-37e321ae-9bfe-4a11-98f6-ae4706f39523 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.179281 May 25 15:00:07.179554 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 352/677] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:06 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:08.190039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:08.190763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:08.201912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:08.201912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:08.201912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:08.201912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:08.338911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:08.348220 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:08.350037 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:08.351243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-54d555fe-c842-4b47-b734-0829b74ffa4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.165982 May 25 15:00:08.351797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 353/678] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:08 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:08.625274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "342ab7d7-30bd-4036-a74f-4950cf646ff7"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:08.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:08.632415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:08.632856 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:08.633607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:08.634036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:10.272784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=25 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.413199 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=50 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.184731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.256097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2f9954a7-7c85-4b72-b805-a735164cf3a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.994125 May 25 15:00:17.256725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 326/679] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:00:00 2022] POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments => generated 194 bytes in 16996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:17.262245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:17.262998 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:17.270907 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:17.270907 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:17.271414 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:17.271820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:17.280565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-283c3582-4b9a-4675-a319-dc46d41ab936 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.773370 May 25 15:00:17.285944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 354/680] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:00:08 2022] POST /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments => generated 194 bytes in 8780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:17.417727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:17.422807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:17.424489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:17.425656 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4a9c1656-80bf-40aa-822b-fc90dd88e02f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.167777 May 25 15:00:17.426335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 327/681] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:17 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:18.445617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:18.446316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:18.453228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:18.453699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:18.455016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:18.455454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:18.588952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:18.598479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:18.600251 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:18.601718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-18d88139-0cec-4aaa-ab2a-28e47deea3da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.160759 May 25 15:00:18.602276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 355/682] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:18 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:19.620909 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:19.621513 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:19.628040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:19.628493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:19.629247 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:19.629680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:19.758133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:19.766734 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:19.768240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:19.769393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8c9f8e0f-5e46-4984-a565-f6e563031447 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.152355 May 25 15:00:19.769950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 328/683] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:19 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:20.787883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:20.788498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:20.790985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=54 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:20.795741 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:20.796192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:20.796962 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:20.797393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:20.926418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:20.934861 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:20.936681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:20.937866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3b04dece-07fe-4e99-929f-34dbf9805f0a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.153877 May 25 15:00:20.938419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 356/684] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:20 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:21.957033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:21.957565 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:21.964081 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:21.964528 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:21.965285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:21.965732 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:22.092094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:22.100547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:22.102520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:22.103713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f717961a-05a0-49d3-9f65-ed461f12f8ab tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.151278 May 25 15:00:22.104271 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 329/685] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:21 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:23.122516 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:23.123158 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:23.130164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:23.130614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:23.131417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:23.131849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:23.258169 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:23.266725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:23.268240 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:23.269423 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-30715197-b9be-441f-b9f2-a09c3a7d3069 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.150739 May 25 15:00:23.269989 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 357/686] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:23 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:24.287464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:24.288089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:24.294680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:24.295129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:24.295891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:24.296322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:24.431883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:24.441148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:24.442592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:24.443785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-26f26827-102f-4742-9196-7b12ad9097d6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.160247 May 25 15:00:24.445217 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 330/687] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:24 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:25.464062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:25.464588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:25.471639 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:25.472090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:25.472861 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:25.473297 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:25.601784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:25.610985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:25.612746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:25.613908 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d6e3ef88-3d44-4e22-ac8d-e44945a4dba7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.154291 May 25 15:00:25.614473 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 358/688] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:25 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:26.620096 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-33e86526-72df-4e40-9531-8b2c8d8e6a27 req-66e23695-4e42-4c09-bab7-168b657db8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "name": "network-vif-plugged", "status": "completed", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:26.631299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-33e86526-72df-4e40-9531-8b2c8d8e6a27 req-66e23695-4e42-4c09-bab7-168b657db8db service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:26.637957 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-33e86526-72df-4e40-9531-8b2c8d8e6a27 req-66e23695-4e42-4c09-bab7-168b657db8db service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:26.638105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:26.638105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:26.639988 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:26.640449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:26.641235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:26.641705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:26.648525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-33e86526-72df-4e40-9531-8b2c8d8e6a27 req-66e23695-4e42-4c09-bab7-168b657db8db service nova] Creating event network-vif-plugged:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 15:00:26.653761 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-33e86526-72df-4e40-9531-8b2c8d8e6a27 req-66e23695-4e42-4c09-bab7-168b657db8db service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037560 May 25 15:00:26.654368 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 331/689] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:26.775280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:26.785278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:26.786804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:26.787957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fe2de49a-ff8e-4bed-86b4-369411bacc2c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.159696 May 25 15:00:26.788522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 359/690] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:26 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:26.961923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:26.962630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:26.968931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:26.969385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:26.970705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:26.971150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:27.109034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:27.117547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-034890bf-28f3-4371-90f0-5af79070b9f2 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1595 microversion: 2.1 time: 0.159835 May 25 15:00:27.118115 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 332/691] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:26 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:27.806944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:27.807565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:27.814329 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:27.814820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:27.815594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:27.816042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:27.962889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:27.972268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:27.973784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:27.974971 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-59f1cf56-7833-41e3-b0b1-4657fa5f487a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.171961 May 25 15:00:27.975541 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 360/692] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:27 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:28.993374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:28.994035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:29.000814 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:29.001479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:29.002290 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:29.003062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:29.134251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:29.143964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:29.145455 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:29.146764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4e6665c7-07d9-4601-9589-70c1b761a938 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.157344 May 25 15:00:29.150457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 333/693] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:28 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:29.680858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-b4ea79e5-b70e-455e-9a29-84427ce7b4ec req-c8650ca8-22e1-46a1-86fa-9bd896928d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:29.689545 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b4ea79e5-b70e-455e-9a29-84427ce7b4ec req-c8650ca8-22e1-46a1-86fa-9bd896928d33 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:29.690374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b4ea79e5-b70e-455e-9a29-84427ce7b4ec req-c8650ca8-22e1-46a1-86fa-9bd896928d33 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:29.701156 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-b4ea79e5-b70e-455e-9a29-84427ce7b4ec req-c8650ca8-22e1-46a1-86fa-9bd896928d33 service nova] Creating event network-changed:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 15:00:29.708371 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-b4ea79e5-b70e-455e-9a29-84427ce7b4ec req-c8650ca8-22e1-46a1-86fa-9bd896928d33 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156241 May 25 15:00:29.709168 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 361/694] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:30.167021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:30.167827 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:30.174618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:30.175252 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:30.176626 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:30.177168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:30.682778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:30.692891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:30.694657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:30.695860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5ec9ff90-3cde-42a9-9ac9-87f85214953c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.533478 May 25 15:00:30.697381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 334/695] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:30 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:31.715943 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:31.716733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:31.723585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:31.724030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:31.724790 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:31.725223 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:31.868791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:31.877420 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:31.878938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:31.880154 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bdd1542d-6c2f-4311-ba06-5c7995f2f91c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1808 microversion: 2.20 time: 0.168546 May 25 15:00:31.880704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 362/696] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:31 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:00:32.512413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-246776648"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:32.512952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:32.520249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:32.520720 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:32.521484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:32.521916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:32.649735 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.network.security_group_api [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Adding security group 41f109ae-642a-4d23-9aee-0fcb2c42d5d4 to port 8cc89087-34bc-4911-a164-56f942a0863e May 25 15:00:32.898576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:32.899445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:32.906879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:32.907334 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:32.908158 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:32.908590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:33.064087 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:33.072619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:33.074130 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:33.075318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5a117d3b-9e32-4176-b4dc-354d8ba1c0f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1795 microversion: 2.20 time: 0.180924 May 25 15:00:33.075966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 363/697] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:00:32 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1795 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:00:33.164012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-31e2ba20-715d-4694-a49b-d8afbfc27b57 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/action" status: 202 len: 0 microversion: 2.1 time: 0.652789 May 25 15:00:33.166815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 335/698] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:00:32 2022] POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:33.182086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:33.186007 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:33.202065 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:33.203049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:33.205640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:33.206018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:33.264767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-dc64bc58-ab72-4ae6-aead-617fdddb5a23 req-03b4e512-bb73-4a84-a12b-f09209695afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:33.274520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-dc64bc58-ab72-4ae6-aead-617fdddb5a23 req-03b4e512-bb73-4a84-a12b-f09209695afc service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:33.275267 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-dc64bc58-ab72-4ae6-aead-617fdddb5a23 req-03b4e512-bb73-4a84-a12b-f09209695afc service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:33.288967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-dc64bc58-ab72-4ae6-aead-617fdddb5a23 req-03b4e512-bb73-4a84-a12b-f09209695afc service nova] Creating event network-changed:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 15:00:33.294714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-dc64bc58-ab72-4ae6-aead-617fdddb5a23 req-03b4e512-bb73-4a84-a12b-f09209695afc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144125 May 25 15:00:33.295567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 364/699] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:00:33.429905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:33.439826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3a79884e-cd33-4753-8523-f5488a275c0e tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1759 microversion: 2.1 time: 0.267596 May 25 15:00:33.440405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 336/700] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:33 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1759 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:34.377454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:34.378522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:34.384705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:34.385155 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:34.385920 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:34.386359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:34.408029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lazy-loading 'flavor' on Instance uuid f2529df8-e20b-49ac-a79a-3591457940dd {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:00:34.776286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-62b9459e-916c-4609-bb75-8e38d63d990f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/action" status: 200 len: 32 microversion: 2.1 time: 0.404153 May 25 15:00:34.776979 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 365/701] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:00:34 2022] POST /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/action => generated 32 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:00:34.786593 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:34.787280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:34.793750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:34.794188 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:34.794986 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:34.795427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:34.939433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:34.947477 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-14832c09-2487-46fc-a273-5e97500a2b80 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.165306 May 25 15:00:34.948065 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 337/702] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:34 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:35.965890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:35.966616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:35.973441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:35.973896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:35.974686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:35.975126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:36.108143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:36.116642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f7570467-8ae1-4cb5-97eb-6d8f6b38f23e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.155020 May 25 15:00:36.117209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 366/703] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:35 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:37.133705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:37.134359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:37.140767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:37.141276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:37.142059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:37.142487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:37.272878 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:37.280746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e41f00cd-3119-4a7f-b174-6b45fb6b2f12 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.150981 May 25 15:00:37.281318 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 338/704] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:37 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:38.297663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:38.298285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:38.304858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:38.305308 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:38.306071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:38.306506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:38.436740 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:38.445256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d249c323-bf7e-43db-9b71-2b88cf3c2cad tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.151471 May 25 15:00:38.445833 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 367/705] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:38 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:39.462768 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:39.463378 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:39.470848 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:39.471303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:39.472066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:39.472504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:39.600919 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:39.608822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-dd208a4f-9afc-4781-a1df-23f7be4e9c19 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.149982 May 25 15:00:39.609398 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 339/706] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:39 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:40.626128 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:40.626866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:40.633046 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:40.633589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:40.634356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:40.634876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:40.794731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:40.803791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a9a8e610-793f-4d51-8417-6c3e708a67f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.181704 May 25 15:00:40.806295 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 368/707] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:40 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:41.821883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:41.822430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:41.824910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=27 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.830108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:41.830558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:41.831347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:41.831781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:41.835671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.960969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:41.968891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5c2acce3-8d94-4998-b21e-18cff43b301a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.151044 May 25 15:00:41.969487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 340/708] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:41 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:42.985858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:42.986445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:42.993044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:42.993531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:42.994295 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:42.994772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:43.126256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:43.134326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b7981392-170b-479a-a85e-346ae7137087 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.152296 May 25 15:00:43.134940 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 369/709] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:42 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:44.151097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:44.151736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:44.159055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:44.159508 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:44.160270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:44.160704 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:44.286333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:44.294333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-479a9a10-6673-4893-9c62-8a5b7bacccbc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.147531 May 25 15:00:44.294934 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 341/710] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:44 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:45.311534 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:45.312143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:45.318971 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:45.319426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:45.320245 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:45.320718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:45.449309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:45.452930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:45.458238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c215258a-db5e-4ede-9359-43d469b5f8af tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.150847 May 25 15:00:45.458836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 370/711] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:45 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:46.475804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:46.476392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:46.483042 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:46.483496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:46.484261 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:46.484736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:46.619259 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:46.627244 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0650475e-8e95-4ede-823e-8496dbd53856 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.155341 May 25 15:00:46.627817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 342/712] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:46 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:47.644885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:47.645527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:47.652712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:47.653162 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:47.653926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:47.654364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:47.784112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:47.792381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5c0d6580-170a-46cd-b428-cb7338dbbc7d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.151664 May 25 15:00:47.792958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 371/713] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:47 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:00:48.809188 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:48.810089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:48.816711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:48.817173 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:48.817944 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:48.818385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:48.946942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:48.955175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-19837827-d521-4cdf-9310-bb90076fcb93 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.149811 May 25 15:00:48.955902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 343/714] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:48 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:49.972608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:49.973259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:49.979915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:49.980368 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:49.981142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:49.981582 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:50.113942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:50.121804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-02f7be57-371f-40c1-8041-d8b440aeb3de tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.153605 May 25 15:00:50.124642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 372/715] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:49 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:51.138793 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:51.139400 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:51.146534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:51.146996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:51.147756 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:51.148184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:51.279213 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:51.287235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3ec829a3-3573-4d4d-a2f7-2325e0912d3f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.152349 May 25 15:00:51.287814 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 344/716] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:51 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:52.304225 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:52.304863 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:52.307214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=34 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.312204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.313198 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.313990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:52.314419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:52.444320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:52.452280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-13a4538b-aaa5-4213-846e-d92d112e465a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.151921 May 25 15:00:52.452851 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 373/717] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:52 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:53.469860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:53.470474 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:53.477072 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.477522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.478295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:53.478758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:53.606539 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:53.614563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fe9b3cb1-7e04-4048-bd39-4cedb200db48 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.149114 May 25 15:00:53.615198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 345/718] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:53 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:54.631613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:54.632163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:54.640472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:54.640940 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:54.641731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:54.642168 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:54.775234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:54.785020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ee62c49b-dd09-40b3-b881-2b8dd023133d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1736 microversion: 2.1 time: 0.157905 May 25 15:00:54.785668 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 374/719] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:54 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:55.801531 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:55.802148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:55.808811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.809271 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.810305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:55.810778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:55.956646 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:55.964780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e8be9f80-8a9f-4b07-aae4-37f586b3352f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1716 microversion: 2.1 time: 0.167190 May 25 15:00:55.965358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 346/720] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:55 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:56.075704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:56.076221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:56.083473 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.083926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.084743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.085202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.212378 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] HTTP exception thrown: Cannot 'detach_volume' instance f2529df8-e20b-49ac-a79a-3591457940dd while it is in vm_state rescued May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Request method failure captured: May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments/342ab7d7-30bd-4036-a74f-4950cf646ff7 HTTP/1.1 May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM_Vk83bilkooRtRyNfZ03pTLQ46Z4dkY0pafDfliwcXZXeOL10HsXQdbsAipIeUJCS_oCw2ccokZeDrNK7tdbnTao9ipYt4QAA_MzzOHO84y567uZ3_xoltAiEvDDCHHMkU7H5Kd5O16_wICPHP9PXJTZBJAE639mbjn9JeflJXSI May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:00:56.213996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9263e6d657dd458d9f497bb868adb941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}] May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: becb6feb52b643279066aef1a7a9f063 May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:00:56.215542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Cannot 'detach_volume' instance f2529df8-e20b-49ac-a79a-3591457940dd while it is in vm_state rescued May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'server_id': 'f2529df8-e20b-49ac-a79a-3591457940dd', 'id': '342ab7d7-30bd-4036-a74f-4950cf646ff7'} May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2529df8-e20b-49ac-a79a-3591457940dd in vm_state rescued. Cannot detach_volume while the instance is in this state. May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:00:56.216203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f2529df8-e20b-49ac-a79a-3591457940dd while it is in vm_state rescued May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f2529df8-e20b-49ac-a79a-3591457940dd while it is in vm_state rescued May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:00:56.217476 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Returning 409 to user: Cannot 'detach_volume' instance f2529df8-e20b-49ac-a79a-3591457940dd while it is in vm_state rescued {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:00:56.218439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ed0fdef5-8625-44bd-8411-c3f819d945ed tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments/342ab7d7-30bd-4036-a74f-4950cf646ff7" status: 409 len: 152 microversion: 2.1 time: 0.143732 May 25 15:00:56.218439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 375/721] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:00:56 2022] DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments/342ab7d7-30bd-4036-a74f-4950cf646ff7 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 15:00:56.225585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:00:56.226156 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:56.233289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.233758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.244459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.244459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.510748 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e5a8dd48-664e-42ca-97b7-2625142f89f9 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "POST /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/action" status: 202 len: 0 microversion: 2.1 time: 0.289522 May 25 15:00:56.511382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 347/722] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:00:56 2022] POST /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:00:56.520252 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:56.520877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:56.527684 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.528140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.528932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:56.529371 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:56.659049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:56.667136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f432600c-6f2b-48b6-ae7d-a6282de6f657 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1724 microversion: 2.1 time: 0.151292 May 25 15:00:56.667716 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 376/723] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:56 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:57.686464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:57.687185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:57.693844 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.694297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.695101 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:57.695537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:57.824830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:57.832927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d481c426-ac6e-40de-9df4-1a57b5989395 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1724 microversion: 2.1 time: 0.151431 May 25 15:00:57.833694 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 348/724] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:57 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:00:58.850232 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:00:58.850933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:00:58.858448 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:58.858992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:58.859818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:00:58.860261 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:00:58.995406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:00:59.003599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d88da808-ac47-4da2-87a2-9be0542f1390 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1724 microversion: 2.1 time: 0.157281 May 25 15:00:59.004167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 377/725] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:00:58 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:00.020836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:00.021437 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:00.028175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:00.028632 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:00.029419 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:00.029857 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:00.160680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:00.168741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-82f225cf-23df-4fb8-a77e-5aaf461ec99e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1724 microversion: 2.1 time: 0.151826 May 25 15:01:00.169329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 349/726] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:00 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:01.187071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:01.188228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:01.195339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:01.195824 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:01.196623 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:01.197068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:01.551806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:01.560034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a1037791-6102-46d3-9aac-eb05991b7558 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1730 microversion: 2.1 time: 0.378370 May 25 15:01:01.560595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 378/727] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:01 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1730 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:01.576835 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:01.577380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:01.584526 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:01.584981 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:01.585752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:01.586194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:01.663122 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f8dc224b-da2c-41da-8af6-04a0d587c35d tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090148 May 25 15:01:01.663746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 350/728] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 15:01:01 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:02.652281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-ab71502f-e546-4471-9974-3c5cc296ceb4 req-7616513e-f694-402d-9691-31b522706c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2529df8-e20b-49ac-a79a-3591457940dd", "tag": "9e663dba-92f0-4076-8dd2-b498d22380ee"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:02.665427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ab71502f-e546-4471-9974-3c5cc296ceb4 req-7616513e-f694-402d-9691-31b522706c7b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:02.665984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ab71502f-e546-4471-9974-3c5cc296ceb4 req-7616513e-f694-402d-9691-31b522706c7b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:02.678669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-ab71502f-e546-4471-9974-3c5cc296ceb4 req-7616513e-f694-402d-9691-31b522706c7b service nova] Creating event network-changed:9e663dba-92f0-4076-8dd2-b498d22380ee for instance f2529df8-e20b-49ac-a79a-3591457940dd on hv-cinder-83028 May 25 15:01:02.684287 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-ab71502f-e546-4471-9974-3c5cc296ceb4 req-7616513e-f694-402d-9691-31b522706c7b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037379 May 25 15:01:02.685379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 379/729] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:04.699236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-6be551c9-2145-4459-ac3a-a3cddb626905 req-36712f12-05b3-4cd9-813f-b502a2485ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2529df8-e20b-49ac-a79a-3591457940dd", "tag": "9e663dba-92f0-4076-8dd2-b498d22380ee"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:04.707475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-6be551c9-2145-4459-ac3a-a3cddb626905 req-36712f12-05b3-4cd9-813f-b502a2485ec3 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:04.707926 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-6be551c9-2145-4459-ac3a-a3cddb626905 req-36712f12-05b3-4cd9-813f-b502a2485ec3 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:04.719574 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-6be551c9-2145-4459-ac3a-a3cddb626905 req-36712f12-05b3-4cd9-813f-b502a2485ec3 service nova] Creating event network-changed:9e663dba-92f0-4076-8dd2-b498d22380ee for instance f2529df8-e20b-49ac-a79a-3591457940dd on hv-cinder-83028 May 25 15:01:04.725427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-6be551c9-2145-4459-ac3a-a3cddb626905 req-36712f12-05b3-4cd9-813f-b502a2485ec3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029579 May 25 15:01:04.725427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 351/730] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:14.339088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:14.339668 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:14.341982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=13 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:14.342671 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=50 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:14.347614 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:14.348087 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:14.348865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:14.349463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:14.432073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lazy-loading 'services' on Instance uuid 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:14.834588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-335d2e77-152d-484d-bee7-87cf5a40da77 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-volume_attachments/885c9970-826c-4548-b8ac-0d37deebacd1" status: 202 len: 0 microversion: 2.1 time: 0.499799 May 25 15:01:14.835248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 380/731] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:01:14 2022] DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-volume_attachments/885c9970-826c-4548-b8ac-0d37deebacd1 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:17.003463 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=23 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.004232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.008462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2a0512c7-1665-4db2-b94e-c3c1c61483fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:17.014661 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a0512c7-1665-4db2-b94e-c3c1c61483fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.020880 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a0512c7-1665-4db2-b94e-c3c1c61483fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:17.038660 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2a0512c7-1665-4db2-b94e-c3c1c61483fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Going to try to stop instance {{(pid=129907) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 15:01:17.255752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2a0512c7-1665-4db2-b94e-c3c1c61483fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.254206 May 25 15:01:17.256362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 352/732] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:01:16 2022] POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:17.266407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:17.267149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:17.273708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.274173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:17.274976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:17.275414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:17.407879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:17.415492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b8a3dc56-aade-41ff-934e-b73a3d1e4e26 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.154753 May 25 15:01:17.417029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 381/733] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:17 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:18.433761 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:18.434745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:18.441984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:18.442438 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:18.443237 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:18.443673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:18.574746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:18.582453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8b507346-2bc8-4cdd-9f95-b7a3b13e55a7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.153353 May 25 15:01:18.582990 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 353/734] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:18 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:19.599807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:19.600427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:19.606933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:19.607420 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:19.608197 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:19.608637 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:19.741962 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:19.750065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cb87c000-1b1f-4c0f-88fa-4685ab2de2c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.153572 May 25 15:01:19.750651 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 382/735] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:19 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:20.767116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:20.767729 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:20.774250 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:20.774748 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:20.775560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:20.775997 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:20.903822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:20.911235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5a4b211a-aee7-4a40-9bad-0421b19bcc71 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.148078 May 25 15:01:20.911786 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 354/736] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:20 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:21.927905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:21.928524 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:21.935481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.935934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:21.936704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:21.937143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:22.068698 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:22.076142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c2c95c54-ca28-4ba3-87eb-318c923f87b4 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.152095 May 25 15:01:22.076699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 383/737] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:21 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:23.095039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:23.095586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:23.101679 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.102146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.102940 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:23.103542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:23.230013 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:23.238071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ca89ae2b-bc0e-4460-a2d8-783faa2f1844 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.147142 May 25 15:01:23.238660 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 355/738] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:23 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:24.255161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:24.255771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:24.262249 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:24.262725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:24.263488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:24.263924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:24.399077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:24.407239 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-95815558-5d85-4129-8e68-fb5b50353aad tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.155883 May 25 15:01:24.407832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 384/739] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:24 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:25.425093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:25.425654 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:25.432127 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:25.432570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:25.433325 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:25.433764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:25.561482 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:25.569283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a80c9a8c-0217-41a5-b0f0-23d6d71a5f15 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.148630 May 25 15:01:25.569841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 356/740] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:25 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:26.586107 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:26.586675 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:26.593765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:26.594208 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:26.595018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:26.595449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:26.729354 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:26.737063 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-62d97f67-1a70-42d3-b786-696d5e2f820a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.154854 May 25 15:01:26.737636 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 385/741] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:26 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:27.753515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:27.754177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:27.760787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:27.761239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:27.762011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:27.762451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:27.898740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:27.907189 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e328c96a-5a3e-4d3e-b386-1f6475115312 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1675 microversion: 2.1 time: 0.157268 May 25 15:01:27.907477 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 357/742] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:27 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:28.924732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:28.925381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:28.932108 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:28.932587 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:28.933405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:28.933836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.063386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:29.070874 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9144261a-b35d-4fb2-84c4-8805881bc757 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1652 microversion: 2.1 time: 0.150537 May 25 15:01:29.074392 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 386/743] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:28 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:29.087478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7561123c-8810-40b0-9c3a-e07ff64e8c11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:29.094019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7561123c-8810-40b0-9c3a-e07ff64e8c11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.094467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7561123c-8810-40b0-9c3a-e07ff64e8c11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.116673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7561123c-8810-40b0-9c3a-e07ff64e8c11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Going to try to start instance {{(pid=129907) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 15:01:29.345068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7561123c-8810-40b0-9c3a-e07ff64e8c11 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.261281 May 25 15:01:29.345621 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 358/744] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:01:29 2022] POST /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:29.353725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:29.354338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:29.360996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.365521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.365521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:29.365521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:29.492612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:29.500270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-761b86f2-f8aa-49fa-b0ad-3ccf207d07fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1661 microversion: 2.1 time: 0.150368 May 25 15:01:29.507537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 387/745] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:29 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:30.518313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:30.519043 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:30.525725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:30.526177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:30.526990 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:30.527428 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:30.660711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:30.668374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8a7a7432-c883-421a-900f-f62be86a8817 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1661 microversion: 2.1 time: 0.154348 May 25 15:01:30.668950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 359/746] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:30 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:31.685790 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:31.686937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:31.693393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:31.693843 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:31.694615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:31.695103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:31.821748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:31.829805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8bcfffb2-8874-453d-a47b-a715b8121c0f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1665 microversion: 2.1 time: 0.148165 May 25 15:01:31.830370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 388/747] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:31 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:34.104353 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:01:34.104960 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:01:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:01:40.331143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:40.335164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:40.338533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.339033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.339902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.340347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.371533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0d8ac846-6233-45d0-8e70-c66257d3576a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments/0f52a1b6-f703-4aa6-b783-8d846a76ddef" status: 200 len: 194 microversion: 2.20 time: 0.044310 May 25 15:01:40.372114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 360/748] 10.222.0.74 () {60 vars in 1453 bytes} [Wed May 25 15:01:40 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments/0f52a1b6-f703-4aa6-b783-8d846a76ddef => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:01:40.435968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:40.437074 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:40.443424 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.444040 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.444819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.445260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.523589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lazy-loading 'services' on Instance uuid 1f09fd70-df36-4976-a829-ebe720c7e516 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:40.751076 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d4776949-321c-4523-b5c2-b65dac4bcc84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments/0f52a1b6-f703-4aa6-b783-8d846a76ddef" status: 202 len: 0 microversion: 2.20 time: 0.319215 May 25 15:01:40.751673 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 389/749] 10.222.0.74 () {60 vars in 1456 bytes} [Wed May 25 15:01:40 2022] DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments/0f52a1b6-f703-4aa6-b783-8d846a76ddef => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:01:40.760058 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:40.760993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:40.767194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.767653 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.768431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.768871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.803177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cf48f7d2-469f-437f-9ccd-c1c5a79feca1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047039 May 25 15:01:40.803736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 361/750] 10.222.0.74 () {60 vars in 1342 bytes} [Wed May 25 15:01:40 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:01:40.820806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:40.824278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:40.828260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.828706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.829596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.830031 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.855126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-95ebd5dd-c401-420d-b3c1-50d0bc890853 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/ips" status: 200 len: 148 microversion: 2.1 time: 0.038525 May 25 15:01:40.855704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 390/751] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 15:01:40 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:40.866154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65bb4738-2700-4a2e-a765-e83f3f4b3c19"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:40.870050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:40.873357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.873899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.874802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.875241 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.964205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Invalid volume: volume 65bb4738-2700-4a2e-a765-e83f3f4b3c19 is already attached to instances: 64837a10-d6e9-4fde-9766-7c03759eae0a May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: POST /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/os-volume_attachments HTTP/1.1 May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 74 May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:01:40.965931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {"volumeAttachment": {"volumeId": "65bb4738-2700-4a2e-a765-e83f3f4b3c19"}} May 25 15:01:40.968143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Invalid volume: volume 65bb4738-2700-4a2e-a765-e83f3f4b3c19 is already attached to instances: 64837a10-d6e9-4fde-9766-7c03759eae0a May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'server_id': '1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e', 'body': {'volumeAttachment': {'volumeId': '65bb4738-2700-4a2e-a765-e83f3f4b3c19'}}} May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65bb4738-2700-4a2e-a765-e83f3f4b3c19 is already attached to instances: 64837a10-d6e9-4fde-9766-7c03759eae0a May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:40.969443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65bb4738-2700-4a2e-a765-e83f3f4b3c19 is already attached to instances: 64837a10-d6e9-4fde-9766-7c03759eae0a May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:40.970968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65bb4738-2700-4a2e-a765-e83f3f4b3c19 is already attached to instances: 64837a10-d6e9-4fde-9766-7c03759eae0a May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 400 to user: Invalid volume: volume 65bb4738-2700-4a2e-a765-e83f3f4b3c19 is already attached to instances: 64837a10-d6e9-4fde-9766-7c03759eae0a {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8c8284b8-4b2e-4718-bf3e-38fe5dda9682 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105298 May 25 15:01:40.972613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 362/752] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:01:40 2022] POST /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:01:40.977057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:40.978891 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:40.984187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.984630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:40.985397 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:40.985828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.010944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:01:41.312455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-62487a53-15ab-4113-b862-50131e9498d8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 204 len: 0 microversion: 2.1 time: 0.338377 May 25 15:01:41.313050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 391/753] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:01:40 2022] DELETE /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:01:41.321286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:41.326112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:41.328812 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.329262 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.330045 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.330484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.465190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:41.472824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9d78e5b4-1225-4ece-86d6-e9e2f4fd9e52 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1680 microversion: 2.1 time: 0.155357 May 25 15:01:41.473427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 363/754] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:41 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:41.498221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:41.500011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:41.506777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.507221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.507982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.508418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.656260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:41.753236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bc600aa7-98b2-49e1-bfe1-5d86918315cd tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/action" status: 202 len: 0 microversion: 2.1 time: 0.259112 May 25 15:01:41.754039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 392/755] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:01:41 2022] POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:41.762134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:41.762857 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:41.769030 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.769538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.770303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.770770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.816122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:41.817339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:41.824265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.824712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.825487 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:41.825916 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:41.855594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7068003d-9037-445e-9107-8fd8bbf35650 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 May 25 15:01:41.856162 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 393/756] 10.222.0.74 () {60 vars in 1342 bytes} [Wed May 25 15:01:41 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 15:01:41.912590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:41.921040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3bdfeade-7bc8-42c6-96e9-a99e6a381e17 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1751 microversion: 2.1 time: 0.162246 May 25 15:01:41.921596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 364/757] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:41 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:42.491577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:42.492180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:42.498067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:42.498516 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:42.499315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:42.499742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:42.628164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:42.635811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-18bc2223-d077-4972-8422-de03f5e9d6c0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1680 microversion: 2.1 time: 0.148135 May 25 15:01:42.636375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 394/758] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:42 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:42.867962 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:42.868938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:42.875387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:42.875891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:42.876634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:42.877067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:42.908184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-29c85d58-0363-4167-a2ae-953b43d9b5ae tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044365 May 25 15:01:42.908939 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 365/759] 10.222.0.74 () {60 vars in 1342 bytes} [Wed May 25 15:01:42 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:01:42.944932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:42.945705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:42.951870 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:42.952320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:42.953225 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:42.953715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:43.135865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:43.144620 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d05b9ce2-83a1-4b41-ab68-cf668b3de440 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1751 microversion: 2.1 time: 0.208880 May 25 15:01:43.145207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 395/760] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:42 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1751 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:43.653674 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:43.654205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:43.661143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:43.661362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:43.662232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:43.662470 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:43.685413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:43.921207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:43.922555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:43.928784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:43.929235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:43.930059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:43.930494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:43.965483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4dd86145-58f0-4731-b937-6ca682021fd6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048982 May 25 15:01:43.966669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 396/761] 10.222.0.74 () {60 vars in 1342 bytes} [Wed May 25 15:01:43 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:44.037657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:44.038159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:44.044471 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:44.044925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:44.046721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:44.046721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:44.073396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:01:44.138764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:44.146671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-95c7e782-dc26-460b-bf3d-4d09d9fb5879 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1680 microversion: 2.1 time: 0.496958 May 25 15:01:44.147328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 366/762] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:43 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1680 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:44.161578 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:44.162193 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:44.168973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:44.169478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:44.171478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:44.171855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:44.392702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:44.401393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-bdb8501c-f7fd-491d-a8c9-a64446c5368a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1751 microversion: 2.1 time: 0.243641 May 25 15:01:44.401973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 367/763] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:44 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:44.445900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5079dcc2-cd59-4d13-bd45-bbf39d497c47 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 204 len: 0 microversion: 2.20 time: 0.411805 May 25 15:01:44.446412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 397/764] 10.222.0.74 () {60 vars in 1279 bytes} [Wed May 25 15:01:44 2022] DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 15:01:44.454568 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:44.455212 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:44.462686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:44.463144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:44.463927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:44.464365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:44.601060 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:44.608960 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:44.610457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:44.611629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-719d3e22-81d3-4a44-baa7-33884dc46f57 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.161052 May 25 15:01:44.612185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 368/765] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:44 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:45.011039 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-e1fed11c-da30-4450-928b-ac30e1a5c6b6 req-4a9ac1d1-a2da-47b0-9368-146a614f5456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e", "name": "network-vif-deleted", "tag": "4611b1ea-e778-46d6-8c99-04a8f2928cb5"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:45.016202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:45.021714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-e1fed11c-da30-4450-928b-ac30e1a5c6b6 req-4a9ac1d1-a2da-47b0-9368-146a614f5456 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.022246 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-e1fed11c-da30-4450-928b-ac30e1a5c6b6 req-4a9ac1d1-a2da-47b0-9368-146a614f5456 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.034695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-e1fed11c-da30-4450-928b-ac30e1a5c6b6 req-4a9ac1d1-a2da-47b0-9368-146a614f5456 service nova] Creating event network-vif-deleted:4611b1ea-e778-46d6-8c99-04a8f2928cb5 for instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e on hv-cinder-83028 May 25 15:01:45.040366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-e1fed11c-da30-4450-928b-ac30e1a5c6b6 req-4a9ac1d1-a2da-47b0-9368-146a614f5456 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033912 May 25 15:01:45.040972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 398/766] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:45.163691 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:45.164303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:45.171076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.171525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.172310 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.172744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.237800 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:45.245553 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2a96efe7-d541-4d37-9f9b-e56ac4a79390 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1612 microversion: 2.1 time: 0.085675 May 25 15:01:45.246120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 369/767] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:45 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:45.420077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:45.421343 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:45.428500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.428977 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.430131 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.430571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.584597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:45.593153 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9953c555-1c8a-485e-9c39-aa8cf967c32d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.177671 May 25 15:01:45.593743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 399/768] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:45 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:45.631001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:45.631827 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:45.638204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.638782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.639643 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:45.640144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:45.778344 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:45.787356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:45.788880 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:45.790073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6703ddca-b64c-4d36-aba1-ae023bcc4d83 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.163056 May 25 15:01:45.791024 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 370/769] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:45 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:46.263630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:46.264264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:46.272780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:46.273235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:46.274024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:46.274794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:46.340089 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:46.347786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-56e912c2-3039-4d5b-a886-7a42b3190c96 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1326 microversion: 2.1 time: 0.088438 May 25 15:01:46.352981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 400/770] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:46 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:46.612030 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:46.612825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:46.619915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:46.620487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:46.621453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:46.622075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:46.784728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:46.793227 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-33281ba4-30cc-447e-a495-0f5e98ccefab tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.185990 May 25 15:01:46.794106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 371/771] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:46 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:46.810134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:46.811033 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:46.818117 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:46.818784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:46.819937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:46.820600 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:46.966759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:46.974958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:46.976772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:46.978172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2d20196b-1ece-4497-ba80-694504c5ad92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1723 microversion: 2.20 time: 0.172715 May 25 15:01:46.990121 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 401/772] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:46 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:47.364997 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:47.367016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:47.369063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=41 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.375018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.375981 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.376910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.377481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.419424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.420295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.421665 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lazy-loading 'fault' on Instance uuid 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:47.476730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:47.488163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a54bb5c7-20cf-43df-aa56-9f88f084c691 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 200 len: 1331 microversion: 2.1 time: 0.127049 May 25 15:01:47.489252 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 372/773] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:47 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:47.611670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-7ffd4ffb-d878-434b-945c-33af28f214b2 req-51bf257f-554a-4b2b-a4f8-f70eadeab67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f09fd70-df36-4976-a829-ebe720c7e516", "name": "network-vif-deleted", "tag": "681873f5-4d38-4cac-8460-0a3e8282503d"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:47.628231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-7ffd4ffb-d878-434b-945c-33af28f214b2 req-51bf257f-554a-4b2b-a4f8-f70eadeab67d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.628766 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-7ffd4ffb-d878-434b-945c-33af28f214b2 req-51bf257f-554a-4b2b-a4f8-f70eadeab67d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.640471 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-7ffd4ffb-d878-434b-945c-33af28f214b2 req-51bf257f-554a-4b2b-a4f8-f70eadeab67d service nova] Creating event network-vif-deleted:681873f5-4d38-4cac-8460-0a3e8282503d for instance 1f09fd70-df36-4976-a829-ebe720c7e516 on hv-cinder-83028 May 25 15:01:47.645732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-7ffd4ffb-d878-434b-945c-33af28f214b2 req-51bf257f-554a-4b2b-a4f8-f70eadeab67d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038354 May 25 15:01:47.647344 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 402/774] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:47.812812 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:47.813463 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:47.820357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.820833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.821617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:47.822063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:47.971725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:47.980243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-77375b18-10d0-4154-ad92-ce924525447c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.172572 May 25 15:01:47.980813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 373/775] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:47 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:47.997602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:47.998312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:48.004656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:48.005109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:48.005924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:48.006362 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:48.078813 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:48.098732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:48.107281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:48.107281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6f6e5fda-e7ca-43d9-b689-bee3dbb8cf4e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 200 len: 1366 microversion: 2.20 time: 0.108224 May 25 15:01:48.107281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 403/776] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:47 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:48.524015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:48.524626 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:48.531384 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:48.531830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:48.532602 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:48.533036 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:48.547388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e HTTP/1.1 May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:01:48.548993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:01:48.550669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e'} May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:48.551547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:01:48.552958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:01:48.554264 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:48.554264 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7a417694-d2fc-4490-b0f3-62218dbc566c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 404 len: 111 microversion: 2.1 time: 0.030376 May 25 15:01:48.554264 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 374/777] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:48 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:01:48.560000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9eeebad7-8493-4446-bae8-ff7a27578cfb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '.version_select at 0x7f6fb4875940>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:48.644427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9eeebad7-8493-4446-bae8-ff7a27578cfb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459565512" status: 202 len: 0 microversion: 2.1 time: 0.088558 May 25 15:01:48.648522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 404/778] 10.222.0.74 () {58 vars in 1217 bytes} [Wed May 25 15:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459565512 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:48.997668 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:48.998337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:49.005144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.005576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.006335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.006816 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.120780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:49.123028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:49.130326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.130915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.131848 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.132368 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.146761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] HTTP exception thrown: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Request method failure captured: May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 HTTP/1.1 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM5abMfRNmSpfxMk1gIjH8D2wwrCIIaEAcmIEHk9Drj6rJc8SDZrS2IIUD-SYSWPdGq-c7ArYzaHMKuYywQIlZ1a6zWpahYrySSwcKfzpl-ULgFCZeTjcP7z7uTvuM-bW989Xzuh4c5gC3i46u70QtvoyKr9Kl8ngRhfQQ0GFMIF70 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:01:49.148699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_18c8213736cf4113951fbb3520c18183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/18c8213736cf4113951fbb3520c18183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}] May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 237510469a8e4e36ad40a34cdf705656 May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:01:49.150447 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '1f09fd70-df36-4976-a829-ebe720c7e516'} May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:49.155309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:01:49.156831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:49.158181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Returning 404 to user: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:49.158181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8b362f4e-f965-44c3-a9e8-c8b90221c311 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 404 len: 111 microversion: 2.20 time: 0.034121 May 25 15:01:49.158181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 405/779] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:49 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:01:49.159402 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c7591631-9a4f-46d0-9bf8-e129b9962c6e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '.version_select at 0x7f6fb4875940>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:49.168831 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:49.176969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f43c5eca-4570-4fe2-8fa7-39c154e0d5a6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.183009 May 25 15:01:49.177640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 375/780] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:48 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:49.264388 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c7591631-9a4f-46d0-9bf8-e129b9962c6e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-771342447" status: 204 len: 0 microversion: 2.20 time: 0.108921 May 25 15:01:49.264986 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 406/781] 10.222.0.74 () {60 vars in 1258 bytes} [Wed May 25 15:01:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-771342447 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 15:01:49.781980 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:49.782534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:49.789114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.789552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.790314 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:49.790778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:49.914618 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lazy-loading 'services' on Instance uuid 64837a10-d6e9-4fde-9766-7c03759eae0a {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:50.123627 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-58690736-118f-41fb-aff7-4499a969e0f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'create', calling method: .version_select at 0x7f6fb4583040>, body: {"keypair": {"name": "tempest-keypair-336321822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodsiYjs6/dCm0BN4VN/SF/Fb8YAHjo9Ebq4BXkfCNQKoo9IOcJK+idwzIyB+Z8Pm5OwR78SANdt99KMXcTg3VrAme+Q8m1BwhNUF36EFDQIiE1ufA34IS/UB2lCbAApQ=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:50.138385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-58690736-118f-41fb-aff7-4499a969e0f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for project 18c8213736cf4113951fbb3520c18183. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:50.142384 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-58690736-118f-41fb-aff7-4499a969e0f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for user 237510469a8e4e36ad40a34cdf705656 and project 18c8213736cf4113951fbb3520c18183. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:50.222560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-35e9cfe6-015f-42df-a6be-d7f480498e2d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments/65bb4738-2700-4a2e-a765-e83f3f4b3c19" status: 202 len: 0 microversion: 2.1 time: 0.444498 May 25 15:01:50.223387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 376/782] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:01:49 2022] DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments/65bb4738-2700-4a2e-a765-e83f3f4b3c19 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:50.228824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:50.229553 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:50.236750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:50.237206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:50.237989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:50.238433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:50.250341 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-58690736-118f-41fb-aff7-4499a969e0f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.131206 May 25 15:01:50.250989 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 407/783] 10.222.0.74 () {62 vars in 1199 bytes} [Wed May 25 15:01:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 25 15:01:50.261347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:50.262281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:50.268552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:50.269005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:50.269780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:50.270396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:50.303120 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-be066819-877e-431c-a5a7-039666c4602c tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 May 25 15:01:50.303895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 408/784] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:01:50 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:50.400635 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:50.408862 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d68d226e-7435-4e55-b81a-20c7c872b4a1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.184138 May 25 15:01:50.415064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 377/785] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:50 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:51.315722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:51.316794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:51.327538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.328040 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.328822 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.329259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.359525 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9df560c1-b418-48c3-a4f1-e80f795eecb8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048351 May 25 15:01:51.360087 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 409/786] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:01:51 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:51.426689 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:51.427324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:51.434031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.434481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.435361 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:51.435797 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:51.601693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:51.610388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2a14bec0-462c-4779-b751-1879ab911de8 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.187768 May 25 15:01:51.610991 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 378/787] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:51 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:52.371460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:52.372402 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:52.379153 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.379665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.380369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.380818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.414654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cc152b1a-f08f-4b25-849d-b7a6a23c6500 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047140 May 25 15:01:52.415157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 410/788] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:01:52 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 15:01:52.476675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:52.477228 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:52.483824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.484278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.485045 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.485483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.511066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Going to try to terminate instance {{(pid=129907) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:01:52.627892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:52.628622 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:52.634839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.635299 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.636086 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:52.636550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:52.785933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:52.794316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e98fe921-2387-47c7-82eb-fa2a45eab99f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.171158 May 25 15:01:52.794937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 411/789] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:52 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:53.009054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0f3f95f2-a495-4f57-805b-a2e678228473 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 204 len: 0 microversion: 2.1 time: 0.536046 May 25 15:01:53.010090 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 379/790] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:01:52 2022] DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:01:53.018345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:53.019021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:53.025143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:53.025595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:53.026467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:53.026941 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:53.162746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:53.166351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:53.170663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-95b7594c-b517-4cf4-8524-eba4e9235aed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1681 microversion: 2.1 time: 0.156367 May 25 15:01:53.171248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 412/791] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:53 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:53.279515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-702394439", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ddfa1ea-b411-4388-afb5-c29ffb748770"}], "security_groups": [{"name": "tempest-securitygroup--2053757087"}], "key_name": "tempest-keypair-336321822", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:53.382540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] validate_networks() for [('0ddfa1ea-b411-4388-afb5-c29ffb748770', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:01:53.812997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:53.813612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:53.821122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:53.821576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:53.822356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:53.822827 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:53.827372 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:01:53.827852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:01:53.828240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:01:53.828649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:01:53.829062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:01:53.838071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:53.838525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:53.839572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:53.840018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:53.857712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for project 18c8213736cf4113951fbb3520c18183. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:53.861927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Getting quotas for user 237510469a8e4e36ad40a34cdf705656 and project 18c8213736cf4113951fbb3520c18183. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:53.874719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:01:53.877488 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:01:53.970343 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:53.978569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a12469d1-203b-4348-8a59-31f46416a6da tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.170592 May 25 15:01:53.979184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 413/792] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:53 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:01:54.068873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-048db58f-0923-424a-9326-b00dff205053 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.794079 May 25 15:01:54.069529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 380/793] 10.222.0.74 () {62 vars in 1187 bytes} [Wed May 25 15:01:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 15:01:54.080462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cd135c7a-9815-41ab-9ca6-b2a9a79e49f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:54.081004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cd135c7a-9815-41ab-9ca6-b2a9a79e49f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:54.138725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cd135c7a-9815-41ab-9ca6-b2a9a79e49f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:54.147892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cd135c7a-9815-41ab-9ca6-b2a9a79e49f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:54.150533 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cd135c7a-9815-41ab-9ca6-b2a9a79e49f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:54.151718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cd135c7a-9815-41ab-9ca6-b2a9a79e49f8 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1280 microversion: 2.20 time: 0.075991 May 25 15:01:54.152497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 414/794] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:54 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:54.189201 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:54.190106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:54.196510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:54.196970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:54.197737 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:54.198174 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:54.343516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:54.349409 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:54.356025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-19a2ccf3-eec4-4890-99bb-2d0af51ad057 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1681 microversion: 2.1 time: 0.170913 May 25 15:01:54.357119 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 381/795] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:54 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:54.996372 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:54.997446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:55.006260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.006763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.007558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.008184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.081153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-939501e3-b095-429a-871c-b72551a52e3e req-65256151-6175-456a-ab67-053809b335c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64837a10-d6e9-4fde-9766-7c03759eae0a", "name": "network-vif-deleted", "tag": "17a70972-093e-43d6-a189-0a0186e2adeb"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:55.090953 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-939501e3-b095-429a-871c-b72551a52e3e req-65256151-6175-456a-ab67-053809b335c2 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.091675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-939501e3-b095-429a-871c-b72551a52e3e req-65256151-6175-456a-ab67-053809b335c2 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.239065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:55.248916 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f7b0f076-1022-4719-92af-205617f80e3b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.256076 May 25 15:01:55.259617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 415/796] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:54 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:55.270890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:55.271731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:55.284742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.285411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.286434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.286918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.289057 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-939501e3-b095-429a-871c-b72551a52e3e req-65256151-6175-456a-ab67-053809b335c2 service nova] Creating event network-vif-deleted:17a70972-093e-43d6-a189-0a0186e2adeb for instance 64837a10-d6e9-4fde-9766-7c03759eae0a on hv-cinder-83028 May 25 15:01:55.295777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-939501e3-b095-429a-871c-b72551a52e3e req-65256151-6175-456a-ab67-053809b335c2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218189 May 25 15:01:55.297396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 382/797] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:01:55.378587 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:55.380460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:55.381177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:55.389830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:55.392172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:55.396186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-50c8bb42-12f9-44e5-a59b-aef72335837d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1284 microversion: 2.20 time: 0.134908 May 25 15:01:55.397421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.400187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.403440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:55.403897 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:55.411448 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 416/798] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:55 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:55.478395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:55.486195 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-33542809-9b16-4cb7-b14e-e830d8447797 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1325 microversion: 2.1 time: 0.112914 May 25 15:01:55.489263 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 383/799] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:55 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1325 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:56.266858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:56.267483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:56.274036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.274511 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.275307 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.283115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.415719 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:56.416469 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:56.423500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.430367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.430367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.430367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.430907 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:56.435944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ef467f9f-074f-4a0a-b93d-935ef44b8a18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.172920 May 25 15:01:56.436499 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 417/800] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:56 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:56.494513 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:56.503399 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:56.506118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:56.506269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:56.506572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:56.507714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3a90757f-2eea-4b53-a3af-cb27e3ea7d1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1332 microversion: 2.20 time: 0.096059 May 25 15:01:56.508483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 384/801] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:56 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:01:56.512173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.512629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.513412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.514403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.545546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:56.546287 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:56.546781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lazy-loading 'fault' on Instance uuid 64837a10-d6e9-4fde-9766-7c03759eae0a {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:01:56.586951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:56.595047 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-766d75c7-f891-472b-8a89-d411719eb88d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 200 len: 1330 microversion: 2.1 time: 0.095547 May 25 15:01:56.595622 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 418/802] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:56 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:57.453421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:57.454116 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:57.460784 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.461230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.462008 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.462443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.526509 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:57.527188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:57.533919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.534378 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.537530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.537985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.616355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:57.624391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:57.625899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:57.627042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-db218620-2130-4536-9393-6d4180d51c79 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1338 microversion: 2.20 time: 0.104372 May 25 15:01:57.627607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 419/803] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:57 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:01:57.632041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:57.632652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:57.642697 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.643163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.643953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:57.644407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:57.659103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a HTTP/1.1 May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:01:57.666786 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:01:57.668206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '64837a10-d6e9-4fde-9766-7c03759eae0a'} May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:01:57.668910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:01:57.670084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:01:57.671810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:01:57.671810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4c84788d-4860-4e45-a159-96fa6ece1f94 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 404 len: 111 microversion: 2.1 time: 0.033510 May 25 15:01:57.671810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 420/804] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:57 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:01:57.672053 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:57.676707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-aae20f63-a4bb-4fa0-88d8-8f596ef818a3 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.227242 May 25 15:01:57.677294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 385/805] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:57 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:57.686765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d57c97f8-bdd1-45a6-a2ac-58c1e51d4c60 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '.version_select at 0x7f6fb4530310>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:57.823762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d57c97f8-bdd1-45a6-a2ac-58c1e51d4c60 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882525112" status: 202 len: 0 microversion: 2.1 time: 0.151664 May 25 15:01:57.824351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 421/806] 10.222.0.74 () {58 vars in 1217 bytes} [Wed May 25 15:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882525112 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:01:58.645562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:58.646191 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:58.654418 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.654918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:58.655684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.656124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:58.694164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:01:58.695744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:01:58.720415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.721126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:58.722094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:58.722537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:59.006396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:59.015175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:59.018341 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:59.020420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8143be8f-d0c8-420a-82ea-d58be2082210 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.378368 May 25 15:01:59.033423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 386/807] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:01:58 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:01:59.049249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-1c06efed-43f6-4fd1-9ca4-7d62e92b1193 req-3aa83701-46be-45ed-892c-d32ac02f4e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:59.053454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:01:59.062460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-1c06efed-43f6-4fd1-9ca4-7d62e92b1193 req-3aa83701-46be-45ed-892c-d32ac02f4e9d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:01:59.062957 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-1c06efed-43f6-4fd1-9ca4-7d62e92b1193 req-3aa83701-46be-45ed-892c-d32ac02f4e9d service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:01:59.065127 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8de51c40-72bb-4c74-9428-622cbdd1820d tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.375410 May 25 15:01:59.065952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 422/808] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:01:58 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:01:59.082620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-1c06efed-43f6-4fd1-9ca4-7d62e92b1193 req-3aa83701-46be-45ed-892c-d32ac02f4e9d service nova] Creating event network-changed:d0275964-ead5-40f3-93a4-63cb2514a0ae for instance 7adffb0a-813f-410e-88eb-e901f068c873 on hv-cinder-83028 May 25 15:01:59.088025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-1c06efed-43f6-4fd1-9ca4-7d62e92b1193 req-3aa83701-46be-45ed-892c-d32ac02f4e9d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043742 May 25 15:01:59.097033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 387/809] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:01:59.325274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-13c3f56f-7a22-4059-aaaf-330823cacb64 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: .version_select at 0x7f6fb468e550>, body: {"keypair": {"name": "tempest-keypair-1767229441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh2DhdhML221hA0hSCujzv/rmb9+Z82ht/MkgyUlohTbUAYRp/A6dlrpXDEzXxzs6craxUSnvYcbnJTvjj3ThQKat442Hg/Wa2ZfiFzN3QjDNhRKnG2mFy+Zu5ZntDJmg=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:01:59.334109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-13c3f56f-7a22-4059-aaaf-330823cacb64 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:01:59.337942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-13c3f56f-7a22-4059-aaaf-330823cacb64 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:01:59.480711 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-13c3f56f-7a22-4059-aaaf-330823cacb64 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166363 May 25 15:01:59.481321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 423/810] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 15:01:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:00.043688 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:00.043688 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:00.055065 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:00.055883 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:00.057285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:00.057989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:00.082233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:00.083903 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:00.089689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:00.090145 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:00.091047 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:00.091489 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:00.204887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:00.213881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:00.215474 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:00.216664 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cd628e92-70a5-4d4f-8a4e-a77501c4bf50 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.180755 May 25 15:02:00.217815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 388/811] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:00 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:00.413395 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:00.421456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ef1d4096-6892-4cd3-8d59-f21d143c2957 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.343568 May 25 15:02:00.422018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 424/812] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:00 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:01.239451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:01.240054 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:01.246622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:01.247104 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:01.247863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:01.248912 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:01.379064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:01.386988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:01.388486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:01.389609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e2a2063c-b638-4e10-9b3d-e80f8b801661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.154054 May 25 15:02:01.390165 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 389/813] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:01 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:02:01.438589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:01.439247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:01.445932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:01.446383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:01.447184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:01.447613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:01.586714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:01.595279 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9a0ec85c-c262-44c9-ad42-4a23e88b0868 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.160464 May 25 15:02:01.595848 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 425/814] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:01 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:02.407649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:02.408313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:02.415281 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:02.415730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:02.416503 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:02.416937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:02.549090 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:02.557104 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:02.558900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:02.559998 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-87289fd2-4f04-4915-91c2-f4046e2141fc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.157309 May 25 15:02:02.560551 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 390/815] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:02 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:02.612292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:02.612906 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:02.619428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:02.619882 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:02.620656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:02.621092 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:02.708202 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-177814815", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa952598-36d5-42ef-b4ac-0f4017a94969"}], "security_groups": [{"name": "tempest-securitygroup--179151581"}], "key_name": "tempest-keypair-1767229441", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:02.771879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:02.779996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-787bbe88-9f36-4a64-89fa-a5729588ddcb tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.171622 May 25 15:02:02.780555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 426/816] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:02 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:02.811941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] validate_networks() for [('fa952598-36d5-42ef-b4ac-0f4017a94969', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:02:03.178297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:02:03.178755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:02:03.179235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:02:03.179646 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:02:03.180059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:02:03.190299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.190778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.191623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.192055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.211104 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:03.213423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:03.224804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:02:03.227305 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:02:03.360712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b49280ba-5514-43c3-8c39-315260f368a4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656650 May 25 15:02:03.361363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 391/817] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:02:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:02:03.372047 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-db0cd3cc-819d-485e-8bd5-5157c80a8c0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:03.372655 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-db0cd3cc-819d-485e-8bd5-5157c80a8c0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:03.432431 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-db0cd3cc-819d-485e-8bd5-5157c80a8c0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:03.438114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-db0cd3cc-819d-485e-8bd5-5157c80a8c0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1241 microversion: 2.1 time: 0.069984 May 25 15:02:03.447758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 427/818] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:03 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:03.579402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:03.579971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:03.586300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.586788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.587573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.588010 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.725602 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:03.733861 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:03.735432 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:03.736575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-513ceed7-bc12-4444-b0d9-d85e4470991a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.162345 May 25 15:02:03.737129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 392/819] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:03 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:03.796263 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:03.796875 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:03.803925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.804369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.805131 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:03.805562 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:03.961453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:03.969508 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1b93f667-375b-48dd-bb1b-597634af7f66 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1756 microversion: 2.1 time: 0.177211 May 25 15:02:03.970072 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 428/820] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:03 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:04.456356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0d652b4d-740f-44f8-8973-aa2b5d011631 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:04.456915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0d652b4d-740f-44f8-8973-aa2b5d011631 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:04.509029 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-0d652b4d-740f-44f8-8973-aa2b5d011631 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:04.516411 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0d652b4d-740f-44f8-8973-aa2b5d011631 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1241 microversion: 2.1 time: 0.064821 May 25 15:02:04.517074 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 393/821] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:04 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:04.756219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:04.756219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:04.762242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:04.762854 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:04.763719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:04.764170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:04.896942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:04.905270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:04.906807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:04.907943 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b7011407-6a4e-48f9-9a55-a45672070a84 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.156586 May 25 15:02:04.908491 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 429/822] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:04 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:04.987003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:04.987693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:04.996031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:04.996483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:04.997267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:04.997707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.147749 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:05.157089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3ca063ed-951d-4ab4-8db5-fe5b37d81f18 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1759 microversion: 2.1 time: 0.174441 May 25 15:02:05.157710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 394/823] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:04 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:05.278783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-34078c17-de42-433a-baa3-be4cd8def73b req-8737d180-326b-4ef2-9e4c-9253b07d1262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "name": "network-vif-plugged", "status": "completed", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:05.287453 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-34078c17-de42-433a-baa3-be4cd8def73b req-8737d180-326b-4ef2-9e4c-9253b07d1262 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.287900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-34078c17-de42-433a-baa3-be4cd8def73b req-8737d180-326b-4ef2-9e4c-9253b07d1262 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.299777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-34078c17-de42-433a-baa3-be4cd8def73b req-8737d180-326b-4ef2-9e4c-9253b07d1262 service nova] Creating event network-vif-plugged:d0275964-ead5-40f3-93a4-63cb2514a0ae for instance 7adffb0a-813f-410e-88eb-e901f068c873 on hv-cinder-83028 May 25 15:02:05.305105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-34078c17-de42-433a-baa3-be4cd8def73b req-8737d180-326b-4ef2-9e4c-9253b07d1262 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084312 May 25 15:02:05.305794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 430/824] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:05.533989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:05.536358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:05.540691 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.541135 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.541895 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.542331 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.607738 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:05.615375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9d89d92f-0d64-42ac-8617-6a6d1ccbf805 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1293 microversion: 2.1 time: 0.085889 May 25 15:02:05.615939 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 395/825] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:05 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:05.926428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:05.927156 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:05.933629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.934149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:05.934938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:05.935375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:06.065012 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:06.072933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:06.074436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:06.075616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f4d405ff-60fc-4014-aa2c-03dc0f1efbe3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.153937 May 25 15:02:06.076892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 431/826] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:05 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:06.632619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:06.633276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:06.640576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:06.641258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:06.642048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:06.642482 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:06.706221 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:06.713796 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b8b6a37f-01da-4047-a410-14ffb1220a82 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1301 microversion: 2.1 time: 0.085377 May 25 15:02:06.714371 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 396/827] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:06 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:07.095990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:07.096959 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:07.100034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:07.105258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:07.105714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:07.106495 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:07.106999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:07.238152 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:07.246207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:07.247700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:07.249385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-89daaa9e-e2b0-43ca-bcd3-15e95a1804cf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1406 microversion: 2.20 time: 0.158453 May 25 15:02:07.249946 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 432/828] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:07 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:07.731287 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:07.732000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:07.739343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:07.739874 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:07.740878 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:07.741320 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:07.805463 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:07.814010 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-398b9ae4-fb01-42f7-bcad-4fc90ed6f03e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1311 microversion: 2.1 time: 0.086903 May 25 15:02:07.814585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 397/829] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:07 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:08.267387 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:08.267966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:08.276392 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.277089 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.278177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.278695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.429239 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:08.437947 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:08.439500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:08.440682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-90a40fd0-5cba-4f16-a486-12e42cb7023e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1599 microversion: 2.20 time: 0.177283 May 25 15:02:08.441240 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 433/830] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:02:08 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:02:08.464948 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:08.465359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:08.472197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.472654 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.473431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.473873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.561125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-88d3c3c2-b227-4dd0-9612-d05e6df2b39c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100202 May 25 15:02:08.562140 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 398/831] 10.222.0.74 () {60 vars in 1315 bytes} [Wed May 25 15:02:08 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:02:08.836271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:08.839982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:08.849115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.852898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.852898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:08.852898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:08.874359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:09.045712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:09.046285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:09.053524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.054241 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.055112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.055615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.151859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:09.151859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-094f16c1-e72a-460d-8cf3-df54f5d981ec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.312388 May 25 15:02:09.151859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 434/832] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:08 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:09.152154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lazy-loading 'services' on Instance uuid f2529df8-e20b-49ac-a79a-3591457940dd {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:09.734793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-2f8a6f48-53b4-4894-9aba-c13f210b023a req-1250b7f3-3fdc-4dd1-a34b-5049c8b19539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4981ccf8-2f23-4afd-a4e3-db0a929a1e1e", "tag": "ba4333a4-99f9-467e-bb63-59997fdfcdcc"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:09.764580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-62220bb3-ab34-42ac-9436-fc94bf7e7205 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments/342ab7d7-30bd-4036-a74f-4950cf646ff7" status: 202 len: 0 microversion: 2.1 time: 0.720179 May 25 15:02:09.764580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 399/833] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:02:09 2022] DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments/342ab7d7-30bd-4036-a74f-4950cf646ff7 => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:02:09.772817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:09.774256 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:09.774561 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-2f8a6f48-53b4-4894-9aba-c13f210b023a req-1250b7f3-3fdc-4dd1-a34b-5049c8b19539 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.775241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-2f8a6f48-53b4-4894-9aba-c13f210b023a req-1250b7f3-3fdc-4dd1-a34b-5049c8b19539 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.782617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.783667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.784624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:09.785254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:09.793756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-2f8a6f48-53b4-4894-9aba-c13f210b023a req-1250b7f3-3fdc-4dd1-a34b-5049c8b19539 service nova] Creating event network-changed:ba4333a4-99f9-467e-bb63-59997fdfcdcc for instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e on hv-cinder-83028 May 25 15:02:09.801049 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-2f8a6f48-53b4-4894-9aba-c13f210b023a req-1250b7f3-3fdc-4dd1-a34b-5049c8b19539 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069305 May 25 15:02:09.806057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 435/834] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:09.827349 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c5469e7d-e2ac-4699-ae29-6d1e6bd694df tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059757 May 25 15:02:09.828267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 400/835] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:02:09 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:10.073696 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-20741330-dc83-4a96-9d44-cf18c29feb1d req-4eb4fd32-e8d5-4737-a23a-05849b35696f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:10.080501 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-20741330-dc83-4a96-9d44-cf18c29feb1d req-4eb4fd32-e8d5-4737-a23a-05849b35696f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:10.080945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-20741330-dc83-4a96-9d44-cf18c29feb1d req-4eb4fd32-e8d5-4737-a23a-05849b35696f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:10.095534 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-20741330-dc83-4a96-9d44-cf18c29feb1d req-4eb4fd32-e8d5-4737-a23a-05849b35696f service nova] Creating event network-changed:d0275964-ead5-40f3-93a4-63cb2514a0ae for instance 7adffb0a-813f-410e-88eb-e901f068c873 on hv-cinder-83028 May 25 15:02:10.101577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-20741330-dc83-4a96-9d44-cf18c29feb1d req-4eb4fd32-e8d5-4737-a23a-05849b35696f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036789 May 25 15:02:10.102585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 436/836] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:10.157355 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:10.158670 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:10.161318 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:10.166368 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:10.166926 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:10.167777 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:10.168290 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:10.172612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:10.302829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:10.311512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-af6c3189-89ab-4906-bccf-2d55fd4c0d22 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.158097 May 25 15:02:10.312339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 401/837] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:10 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:10.840910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:10.841935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:10.848748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:10.849265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:10.850055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:10.850494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:10.882964 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1faeff99-8dbb-4a2d-ab47-b2ba8f94588e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 May 25 15:02:10.883735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 437/838] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:02:10 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:11.329560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:11.330130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:11.338652 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:11.339115 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:11.339897 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:11.340364 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:11.476343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:11.494484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2402d56b-fcdc-4f47-a49d-5c2d83858e15 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.159529 May 25 15:02:11.494484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 402/839] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:11 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:11.894782 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:11.895635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:11.902135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:11.902579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:11.903406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:11.903865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:11.933005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e62e2c08-05f6-4367-9c77-f8b97dcd7613 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042283 May 25 15:02:11.933847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 438/840] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:02:11 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:02:12.017000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:12.017503 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:12.024752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:12.026849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:12.026849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:12.026849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:12.053276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Going to try to terminate instance {{(pid=129907) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:12.501455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:12.502064 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:12.508099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:12.508554 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:12.509357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:12.509800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:12.608450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-0b960bfc-5952-4960-a93d-0761e8b476cc tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 204 len: 0 microversion: 2.1 time: 0.595525 May 25 15:02:12.609377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 403/841] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:02:12 2022] DELETE /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:12.617686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:12.618562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:12.625320 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:12.625774 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:12.626547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:12.627013 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:12.640956 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:12.648518 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-58842f8f-e03c-4bc3-80ea-0aa7fb4a2891 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.151408 May 25 15:02:12.649094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 439/842] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:12 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:12.759231 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:12.767289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2e34c467-b25d-4c4d-898e-c9c502eeb4ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.153939 May 25 15:02:12.767947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 404/843] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:12 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:13.665763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:13.666376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:13.668972 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=12 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:13.674109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:13.674565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:13.675389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:13.675840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:13.785752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:13.786369 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:13.788433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=4 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:13.794092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:13.794539 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:13.795381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:13.795821 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:13.826452 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:13.834260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3bdfc307-e113-44c9-b8a9-fd4cc5eef9ce tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.172520 May 25 15:02:13.854626 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 440/844] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:13 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:13.927868 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:13.936052 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c07e52ea-03d6-400d-863f-e69a97365d74 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.154463 May 25 15:02:13.936629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 405/845] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:13 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:14.851727 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:14.852291 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:14.860775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:14.861224 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:14.862009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:14.862455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:14.953548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:14.954151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:14.956225 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=14 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:14.962429 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:14.963044 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:14.963993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:14.964887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:15.002763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:15.019464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-99ad6bb4-5277-41d3-bf59-283329a783ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.171633 May 25 15:02:15.020258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 441/846] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:14 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:15.111118 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:15.119088 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a497b85d-e0e4-4eb0-b547-fe5ebecddf78 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.169967 May 25 15:02:15.119677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 406/847] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:14 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:16.037346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:16.038176 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:16.046443 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:16.046935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:16.047734 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:16.048174 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:16.139533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:16.140259 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:16.147492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:16.147947 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:16.148729 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:16.149170 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:16.201893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:16.209553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1afae8a8-53ba-469e-a5b4-798b41f675c3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.176841 May 25 15:02:16.210143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 442/848] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:16 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:16.288222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:16.297374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-eafc8173-563b-4eb5-aab7-73e9c08f9504 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.162095 May 25 15:02:16.297951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 407/849] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:16 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:17.227199 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:17.227840 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:17.235010 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:17.235457 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:17.236229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:17.236660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:17.318023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:17.318733 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:17.327382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:17.327917 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:17.328860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:17.329389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:17.388156 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:17.397073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2f9341df-f733-4642-afad-467b54f1cf51 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.173752 May 25 15:02:17.397660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 443/850] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:17 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:17.476889 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:17.487400 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-30fbbae2-dee7-4b12-bb09-3fd78a350761 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.175177 May 25 15:02:17.487985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 408/851] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:17 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:17.573556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-b24b4abe-596e-482b-a385-5cc8336a83ad req-b4f7baa5-35b6-4d26-8ded-5e64eac16724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4981ccf8-2f23-4afd-a4e3-db0a929a1e1e", "name": "network-vif-plugged", "status": "completed", "tag": "ba4333a4-99f9-467e-bb63-59997fdfcdcc"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:17.582347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b24b4abe-596e-482b-a385-5cc8336a83ad req-b4f7baa5-35b6-4d26-8ded-5e64eac16724 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:17.582911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b24b4abe-596e-482b-a385-5cc8336a83ad req-b4f7baa5-35b6-4d26-8ded-5e64eac16724 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:17.594143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-b24b4abe-596e-482b-a385-5cc8336a83ad req-b4f7baa5-35b6-4d26-8ded-5e64eac16724 service nova] Creating event network-vif-plugged:ba4333a4-99f9-467e-bb63-59997fdfcdcc for instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e on hv-cinder-83028 May 25 15:02:17.630916 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-b24b4abe-596e-482b-a385-5cc8336a83ad req-b4f7baa5-35b6-4d26-8ded-5e64eac16724 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029351 May 25 15:02:17.630916 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 444/852] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:18.413472 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:18.414197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:18.420889 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.421356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.422131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.422567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.509825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:18.510526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:18.518475 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.518963 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.519908 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:18.520346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:18.571208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:18.579326 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-982b7b42-00d2-46f5-90b0-fd960fddfcec tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.169801 May 25 15:02:18.579906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 409/853] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:18 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:18.657898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:18.665877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0d7dcd89-986f-4261-8e77-15988cacb475 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.162997 May 25 15:02:18.666463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 445/854] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:18 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:19.597204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:19.597887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:19.605290 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:19.605827 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:19.606610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:19.607743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:19.682492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:19.683386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:19.690250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:19.690803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:19.691581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:19.692014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:19.766722 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:19.774983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e3555653-5a80-4bbd-bb9e-d3f0f1da908d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1366 microversion: 2.1 time: 0.181686 May 25 15:02:19.775570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 410/855] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:19 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:19.837288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:19.845767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-14e7d765-2d02-4123-a885-4de7f8d4c6b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1690 microversion: 2.1 time: 0.167278 May 25 15:02:19.846345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 446/856] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:19 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:20.795475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:20.796156 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:20.796735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-eac61731-6f30-478a-9938-5713c7ede1fa req-f6167dce-11d5-4d54-9836-0c66a70fea3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2529df8-e20b-49ac-a79a-3591457940dd", "name": "network-vif-deleted", "tag": "9e663dba-92f0-4076-8dd2-b498d22380ee"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:20.802782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.803231 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.804018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.804454 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.807668 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-eac61731-6f30-478a-9938-5713c7ede1fa req-f6167dce-11d5-4d54-9836-0c66a70fea3b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.808509 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-eac61731-6f30-478a-9938-5713c7ede1fa req-f6167dce-11d5-4d54-9836-0c66a70fea3b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.821770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-eac61731-6f30-478a-9938-5713c7ede1fa req-f6167dce-11d5-4d54-9836-0c66a70fea3b service nova] Creating event network-vif-deleted:9e663dba-92f0-4076-8dd2-b498d22380ee for instance f2529df8-e20b-49ac-a79a-3591457940dd on hv-cinder-83028 May 25 15:02:20.829157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-eac61731-6f30-478a-9938-5713c7ede1fa req-f6167dce-11d5-4d54-9836-0c66a70fea3b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 May 25 15:02:20.830341 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 447/857] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:20.863881 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:20.864888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:20.872918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.873678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.874751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:20.875358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:20.976993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:20.986964 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a3324330-d6b9-4bf3-aa26-6ce731b99721 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1622 microversion: 2.1 time: 0.127173 May 25 15:02:20.987483 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 448/858] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:20 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1622 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:21.023804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:21.030109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6cbe4748-47cc-441a-8897-044ee50eb1b5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1556 microversion: 2.1 time: 0.241171 May 25 15:02:21.030984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 411/859] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:20 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:21.048374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:21.048884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:21.055979 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:21.056701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:21.057684 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:21.058423 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:21.156446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3010ae24-2ee9-4c65-87cf-e15d8675e224 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109544 May 25 15:02:21.156446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 449/860] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 15:02:21 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:22.005811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:22.006513 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:22.012935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.013417 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.014335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.014814 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.049736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.049736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.049736 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lazy-loading 'fault' on Instance uuid f2529df8-e20b-49ac-a79a-3591457940dd {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:22.114868 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:22.129695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1748849a-ced7-41a7-8113-5db0ec32d0b4 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 200 len: 1335 microversion: 2.1 time: 0.127919 May 25 15:02:22.130610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 412/861] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:22 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:02:22.515950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-8103eeb8-581e-40cb-a82b-9c7de30a0756 req-656170ae-c874-4eb5-8a0b-d04764c403dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4981ccf8-2f23-4afd-a4e3-db0a929a1e1e", "tag": "ba4333a4-99f9-467e-bb63-59997fdfcdcc"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:22.524836 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8103eeb8-581e-40cb-a82b-9c7de30a0756 req-656170ae-c874-4eb5-8a0b-d04764c403dd service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:22.525302 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8103eeb8-581e-40cb-a82b-9c7de30a0756 req-656170ae-c874-4eb5-8a0b-d04764c403dd service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:22.537412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-8103eeb8-581e-40cb-a82b-9c7de30a0756 req-656170ae-c874-4eb5-8a0b-d04764c403dd service nova] Creating event network-changed:ba4333a4-99f9-467e-bb63-59997fdfcdcc for instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e on hv-cinder-83028 May 25 15:02:22.544044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-8103eeb8-581e-40cb-a82b-9c7de30a0756 req-656170ae-c874-4eb5-8a0b-d04764c403dd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032306 May 25 15:02:22.545340 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 450/862] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:23.150480 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:23.151383 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: f2529df8-e20b-49ac-a79a-3591457940dd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:23.158248 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:23.158760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:23.159607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:23.160106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:23.175076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] HTTP exception thrown: Instance f2529df8-e20b-49ac-a79a-3591457940dd could not be found. May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Request method failure captured: May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd HTTP/1.1 May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM_Vk83bilkooRtRyNfZ03pTLQ46Z4dkY0pafDfliwcXZXeOL10HsXQdbsAipIeUJCS_oCw2ccokZeDrNK7tdbnTao9ipYt4QAA_MzzOHO84y567uZ3_xoltAiEvDDCHHMkU7H5Kd5O16_wICPHP9PXJTZBJAE639mbjn9JeflJXSI May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:02:23.177185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9263e6d657dd458d9f497bb868adb941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}] May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: becb6feb52b643279066aef1a7a9f063 May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance f2529df8-e20b-49ac-a79a-3591457940dd could not be found. May 25 15:02:23.178692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': 'f2529df8-e20b-49ac-a79a-3591457940dd'} May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2529df8-e20b-49ac-a79a-3591457940dd could not be found. May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:23.182743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2529df8-e20b-49ac-a79a-3591457940dd could not be found. May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2529df8-e20b-49ac-a79a-3591457940dd could not be found. May 25 15:02:23.184479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:02:23.186313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Returning 404 to user: Instance f2529df8-e20b-49ac-a79a-3591457940dd could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:23.186313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2b16e207-0eac-4595-bfe8-2226153052ab tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd" status: 404 len: 111 microversion: 2.1 time: 0.031787 May 25 15:02:23.186313 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 413/863] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:23 2022] GET /compute/v2.1/servers/f2529df8-e20b-49ac-a79a-3591457940dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:23.191548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fbb892a2-da0c-40d4-a3fb-a7db8f53351f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '.version_select at 0x7f6fb4a0a5e0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:23.291945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fbb892a2-da0c-40d4-a3fb-a7db8f53351f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845499951" status: 202 len: 0 microversion: 2.1 time: 0.106627 May 25 15:02:23.292429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 451/864] 10.222.0.74 () {58 vars in 1220 bytes} [Wed May 25 15:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845499951 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:02:26.755695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:26.756277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:26.762908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:26.763359 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:26.764126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:26.764561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:26.789508 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Going to try to terminate instance {{(pid=129907) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:26.929804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:27.168300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5542be7b-8731-446a-804f-97ffdb6c5a5e tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "DELETE /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 204 len: 0 microversion: 2.1 time: 0.416011 May 25 15:02:27.168806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 414/865] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:02:26 2022] DELETE /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:27.177254 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:27.177998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:27.185479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:27.185935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:27.186742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:27.187178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:27.318617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:27.326953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fb111d79-e460-4cfc-8e65-7f8ecd44e0b7 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1509 microversion: 2.1 time: 0.153624 May 25 15:02:27.327521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 452/866] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:27 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:28.344110 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:28.344841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:28.351915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:28.352369 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:28.353145 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:28.353581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:28.493586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:28.501415 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7a420337-ef1a-4c15-8464-e6e4b80b30fa tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1509 microversion: 2.1 time: 0.162019 May 25 15:02:28.507309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 415/867] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:28 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:29.182351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-75a3632c-a80e-4750-b666-25f238afd649 req-b0f910b9-af8c-4dfd-931b-d2924d1df5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d026df3e-764d-4346-8f57-3439f8239339", "name": "network-vif-deleted", "tag": "ea7e1e22-9f9c-40eb-968a-be0fb1f82f9b"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:29.191426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-75a3632c-a80e-4750-b666-25f238afd649 req-b0f910b9-af8c-4dfd-931b-d2924d1df5f9 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:29.191869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-75a3632c-a80e-4750-b666-25f238afd649 req-b0f910b9-af8c-4dfd-931b-d2924d1df5f9 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:29.203146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-75a3632c-a80e-4750-b666-25f238afd649 req-b0f910b9-af8c-4dfd-931b-d2924d1df5f9 service nova] Creating event network-vif-deleted:ea7e1e22-9f9c-40eb-968a-be0fb1f82f9b for instance d026df3e-764d-4346-8f57-3439f8239339 on hv-cinder-83028 May 25 15:02:29.208325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-75a3632c-a80e-4750-b666-25f238afd649 req-b0f910b9-af8c-4dfd-931b-d2924d1df5f9 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029845 May 25 15:02:29.209236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 453/868] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:29.519701 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:29.520261 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:29.526863 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:29.527323 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:29.528107 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:29.529407 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:29.592903 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:29.601106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a72c630a-41ae-4080-8d50-426e63421600 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 200 len: 1293 microversion: 2.1 time: 0.085431 May 25 15:02:29.601672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 416/869] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:29 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:30.620015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:30.620787 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: d026df3e-764d-4346-8f57-3439f8239339] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:30.628686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:30.629227 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:30.630099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:30.630611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:30.646899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] HTTP exception thrown: Instance d026df3e-764d-4346-8f57-3439f8239339 could not be found. May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Request method failure captured: May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 HTTP/1.1 May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM_Vk83bilkooRtRyNfZ03pTLQ46Z4dkY0pafDfliwcXZXeOL10HsXQdbsAipIeUJCS_oCw2ccokZeDrNK7tdbnTao9ipYt4QAA_MzzOHO84y567uZ3_xoltAiEvDDCHHMkU7H5Kd5O16_wICPHP9PXJTZBJAE639mbjn9JeflJXSI May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:02:30.648855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9263e6d657dd458d9f497bb868adb941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}] May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: becb6feb52b643279066aef1a7a9f063 May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance d026df3e-764d-4346-8f57-3439f8239339 could not be found. May 25 15:02:30.650442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'd026df3e-764d-4346-8f57-3439f8239339'} May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d026df3e-764d-4346-8f57-3439f8239339 could not be found. May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:30.654535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d026df3e-764d-4346-8f57-3439f8239339 could not be found. May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d026df3e-764d-4346-8f57-3439f8239339 could not be found. May 25 15:02:30.656053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:30.657364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Returning 404 to user: Instance d026df3e-764d-4346-8f57-3439f8239339 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:30.657364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-897b8ed0-4473-4087-8598-9278acca16ce tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339" status: 404 len: 111 microversion: 2.1 time: 0.036203 May 25 15:02:30.657364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 454/870] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:30 2022] GET /compute/v2.1/servers/d026df3e-764d-4346-8f57-3439f8239339 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:30.659905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:30.660409 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:30.667221 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:30.667727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:30.668577 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:30.669059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:30.694677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Going to try to terminate instance {{(pid=129907) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:31.081808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-caed2c34-f74c-40f6-acd5-2e85265bc02f tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "DELETE /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 204 len: 0 microversion: 2.1 time: 0.425753 May 25 15:02:31.082485 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 417/871] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:02:30 2022] DELETE /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 15:02:31.090728 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:31.092611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:31.097642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:31.098093 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:31.098904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:31.099348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:31.229456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:31.238373 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ae2a60c6-3887-45be-9ce9-305bddf3651a tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.151490 May 25 15:02:31.239029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 455/872] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:31 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:32.257950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:32.258731 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:32.266257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:32.266747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:32.267514 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:32.267949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:32.403433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:32.411498 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-311ea25d-252c-47dc-87f4-09a07e52a5c0 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1522 microversion: 2.1 time: 0.158112 May 25 15:02:32.414535 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 418/873] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:32 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:33.341413 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-367c920d-951d-47f6-92b2-32f1693f133a req-4f93652c-995a-48ad-acdd-b646c1223464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c1f5bd-4a13-4a35-9607-5bbff2d886e0", "name": "network-vif-deleted", "tag": "e4ee92ba-bfd1-4a4a-94b6-1a50990a69b8"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:33.352834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-367c920d-951d-47f6-92b2-32f1693f133a req-4f93652c-995a-48ad-acdd-b646c1223464 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.353589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-367c920d-951d-47f6-92b2-32f1693f133a req-4f93652c-995a-48ad-acdd-b646c1223464 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.369272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-367c920d-951d-47f6-92b2-32f1693f133a req-4f93652c-995a-48ad-acdd-b646c1223464 service nova] Creating event network-vif-deleted:e4ee92ba-bfd1-4a4a-94b6-1a50990a69b8 for instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 on hv-cinder-83028 May 25 15:02:33.376327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-367c920d-951d-47f6-92b2-32f1693f133a req-4f93652c-995a-48ad-acdd-b646c1223464 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039966 May 25 15:02:33.376935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 456/874] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:33.429410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:33.430192 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:33.438413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.439237 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.439675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:33.440148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:33.515114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becb6feb52b643279066aef1a7a9f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9263e6d657dd458d9f497bb868adb941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:33.523019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7df648b4-eb22-49bf-afe8-a100c06c8817 tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 200 len: 1480 microversion: 2.1 time: 0.097326 May 25 15:02:33.523499 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 419/875] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:33 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 1480 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:34.540897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:34.541605 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] [instance: 54c1f5bd-4a13-4a35-9607-5bbff2d886e0] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:34.548419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:34.548876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:34.549652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:34.550149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:34.564804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] HTTP exception thrown: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 could not be found. May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Request method failure captured: May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 HTTP/1.1 May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM_Vk83bilkooRtRyNfZ03pTLQ46Z4dkY0pafDfliwcXZXeOL10HsXQdbsAipIeUJCS_oCw2ccokZeDrNK7tdbnTao9ipYt4QAA_MzzOHO84y567uZ3_xoltAiEvDDCHHMkU7H5Kd5O16_wICPHP9PXJTZBJAE639mbjn9JeflJXSI May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:02:34.566494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9263e6d657dd458d9f497bb868adb941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9263e6d657dd458d9f497bb868adb941"}]}] May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 9263e6d657dd458d9f497bb868adb941 May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2136478607 May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: becb6feb52b643279066aef1a7a9f063 May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2136478607-project May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 could not be found. May 25 15:02:34.568027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '54c1f5bd-4a13-4a35-9607-5bbff2d886e0'} May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 could not be found. May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:34.568858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 could not be found. May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 could not be found. May 25 15:02:34.570024 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:34.571186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] Returning 404 to user: Instance 54c1f5bd-4a13-4a35-9607-5bbff2d886e0 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:34.571186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4ae906cc-a7a4-47ca-b8f7-65e25bb294fd tempest-ServerRescueNegativeTestJSON-2136478607 tempest-ServerRescueNegativeTestJSON-2136478607-project] 10.222.0.74 "GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0" status: 404 len: 111 microversion: 2.1 time: 0.031554 May 25 15:02:34.571186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 457/876] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:34 2022] GET /compute/v2.1/servers/54c1f5bd-4a13-4a35-9607-5bbff2d886e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:02:36.414318 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:36.415436 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.423114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.423620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.424448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.424938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.459197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-aaab5810-e7bd-441f-8311-eeec27545981 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049461 May 25 15:02:36.460293 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 420/877] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:02:36 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:02:36.531304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:36.531904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.539321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.539722 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.540721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.541157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.562974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.577451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:02:36.893659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d34824f2-63e4-4c8d-9d52-d82c8b60400a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 204 len: 0 microversion: 2.1 time: 0.366459 May 25 15:02:36.894182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 458/878] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:02:36 2022] DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:02:36.902377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:36.903011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:36.909686 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.912066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:36.912066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:36.912066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:37.070175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:37.079017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-bf945da4-4c9e-4b22-9707-7bce33f934fd tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1671 microversion: 2.1 time: 0.180341 May 25 15:02:37.079710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 421/879] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:36 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:38.098405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:38.099973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:38.107596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:38.108153 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:38.109280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:38.109822 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:38.249760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:38.257860 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9f411013-79a0-4688-a1cf-a42ea7d652c1 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1671 microversion: 2.1 time: 0.164630 May 25 15:02:38.264435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 459/880] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:38 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:39.283859 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:39.285112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:39.292388 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.293100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.294727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.295329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.457449 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:39.465225 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-aef64fb2-c9f0-49ef-a929-69d4e30bd777 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1671 microversion: 2.1 time: 0.192933 May 25 15:02:39.469803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 422/881] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:39 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:39.872016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-d0926446-f2cf-4ab5-b40a-378b4e7b5ce0 req-ac2356b2-48d2-4aa0-ac2d-8a98d8574b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed", "name": "network-vif-deleted", "tag": "1adf867b-8b01-47c8-9071-efb5a796ac50"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:39.877607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:39.881830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d0926446-f2cf-4ab5-b40a-378b4e7b5ce0 req-ac2356b2-48d2-4aa0-ac2d-8a98d8574b47 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:39.882268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d0926446-f2cf-4ab5-b40a-378b4e7b5ce0 req-ac2356b2-48d2-4aa0-ac2d-8a98d8574b47 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:39.897407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-d0926446-f2cf-4ab5-b40a-378b4e7b5ce0 req-ac2356b2-48d2-4aa0-ac2d-8a98d8574b47 service nova] Creating event network-vif-deleted:1adf867b-8b01-47c8-9071-efb5a796ac50 for instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed on hv-cinder-83028 May 25 15:02:39.913682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-d0926446-f2cf-4ab5-b40a-378b4e7b5ce0 req-ac2356b2-48d2-4aa0-ac2d-8a98d8574b47 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045916 May 25 15:02:39.914760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 460/882] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:40.482552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:40.483269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:40.490070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.490523 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.491353 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.491801 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.524358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:40.524822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:40.525275 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lazy-loading 'fault' on Instance uuid 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:02:40.574405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:40.583328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-447205ee-ed50-4076-84b8-c68eb30917f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 200 len: 1325 microversion: 2.1 time: 0.104726 May 25 15:02:40.589475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 423/883] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:40 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 1325 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:41.600312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:41.601016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:41.608318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.608777 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.609557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:41.609998 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:41.623681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] HTTP exception thrown: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Request method failure captured: May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed HTTP/1.1 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM8latX2PnMvTXqg1ny6zXP1ILvRuQOFW9LSq-mVPhkT4QzGGM2ob5Cd8EcJAKlwkc4YOU2q7J-h_9ULjFYF_TKjxN-0_ERhEiWPd63LGmdOyl1sdRbrzCybzY5EIfTZuJagmNN3Yed_qP9cJiF5Hxb2bdWK2jX4RujuzoJVBtMv04 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:02:41.625346 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}] May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeTestJSON-394737464 May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeTestJSON-394737464-project May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 9dba831ebb584de5a0c84f39901d3c32 May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeTestJSON-394737464-project May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:02:41.626816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed'} May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:02:41.627717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:02:41.628992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:02:41.630459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Returning 404 to user: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:02:41.630459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-42373285-b05e-43e6-8219-0e6c6b95e60d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 404 len: 111 microversion: 2.1 time: 0.030640 May 25 15:02:41.630459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 461/884] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:41 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:02:41.635876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a4419691-3a89-4c28-8e64-b4757e225165 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '.version_select at 0x7f6fb47fa940>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:41.754466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a4419691-3a89-4c28-8e64-b4757e225165 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-858382302" status: 202 len: 0 microversion: 2.1 time: 0.122238 May 25 15:02:41.754998 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 424/885] 10.222.0.74 () {58 vars in 1217 bytes} [Wed May 25 15:02:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-858382302 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:02:42.587339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c7bfada1-e961-4149-a37e-d2caf4ac330e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: .version_select at 0x7f6fb4620550>, body: {"keypair": {"name": "tempest-keypair-1930081246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmYAhma3kUjDopmRp8ZKZ5e8MDHkcnPJIYHzQlBaJYHcPeOn0F7YSliiGFetTrJFgNLsEg5GO1tMKRToSigh54O9BhazixbbrG9/wJD4/iKYoKl1GrlWsNbuGkhKv/wPA=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:42.602402 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-c7bfada1-e961-4149-a37e-d2caf4ac330e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:42.607449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-c7bfada1-e961-4149-a37e-d2caf4ac330e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for user 9dba831ebb584de5a0c84f39901d3c32 and project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:42.724109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c7bfada1-e961-4149-a37e-d2caf4ac330e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140546 May 25 15:02:42.724747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 462/886] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 15:02:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:45.766378 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-519239410", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebc02943-e245-4287-8851-2c76f257286a"}], "security_groups": [{"name": "tempest-securitygroup--1313849284"}], "key_name": "tempest-keypair-1930081246", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:45.774252 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.870107 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] validate_networks() for [('ebc02943-e245-4287-8851-2c76f257286a', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:02:46.254117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:02:46.254542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:02:46.255893 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:02:46.256317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:02:46.256728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:02:46.266154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.266611 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:46.267445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:46.267917 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:46.288582 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:02:46.292890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Getting quotas for user 9dba831ebb584de5a0c84f39901d3c32 and project 89a36e186c5f4d3c8b9030d91f6a30f6. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:02:46.305177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:02:46.307989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:02:46.508468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2165d452-d56d-4f9f-9f49-144428b0d3c0 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746755 May 25 15:02:46.508884 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 425/887] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:02:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:02:46.519540 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f772fcc9-930e-4fbb-958c-7f561a3e2e1c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:46.520175 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f772fcc9-930e-4fbb-958c-7f561a3e2e1c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:46.581632 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f772fcc9-930e-4fbb-958c-7f561a3e2e1c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:46.588731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f772fcc9-930e-4fbb-958c-7f561a3e2e1c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1237 microversion: 2.1 time: 0.073731 May 25 15:02:46.589514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 463/888] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:46 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:47.610792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:47.611405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:47.617675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:47.618130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.618933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:47.619377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:47.689294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:47.691492 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6ecfc617-ffbf-449a-b4aa-0adbc0a3c894 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1241 microversion: 2.1 time: 0.088038 May 25 15:02:47.692062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 426/889] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:47 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:48.709601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:48.710159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:48.717589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:48.718042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:48.718860 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:48.719387 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:48.793608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:48.802048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-62421a02-e5ef-4dc8-b142-6e898aaf4cf3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1289 microversion: 2.1 time: 0.096589 May 25 15:02:48.802615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 464/890] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:48 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:49.823311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:49.823690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:49.830001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:49.832727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:49.832727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:49.832727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:49.896698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:49.905050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-135e56ac-49d1-4a41-81c1-c2124d45a8fb tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1295 microversion: 2.1 time: 0.089127 May 25 15:02:49.905949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 427/891] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:49 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:50.922745 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:50.923417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:50.930015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:50.930733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:50.931258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:50.931707 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:51.087112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:51.096144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-42a30727-b004-45c1-bb6f-e61d660dcc25 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.177473 May 25 15:02:51.097094 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 465/892] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:50 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:51.526957 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-2186a722-c5e1-40e7-b279-0c88df71dc49 req-5aadc806-fb1c-4972-acb8-f5c5ad64b3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85103939-9db9-4bb5-943d-2236c81b7820", "tag": "b4734f99-b653-4271-85f9-99aee86cd902"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:51.538711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-2186a722-c5e1-40e7-b279-0c88df71dc49 req-5aadc806-fb1c-4972-acb8-f5c5ad64b3a4 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:51.539146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-2186a722-c5e1-40e7-b279-0c88df71dc49 req-5aadc806-fb1c-4972-acb8-f5c5ad64b3a4 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:51.552410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-2186a722-c5e1-40e7-b279-0c88df71dc49 req-5aadc806-fb1c-4972-acb8-f5c5ad64b3a4 service nova] Creating event network-changed:b4734f99-b653-4271-85f9-99aee86cd902 for instance 85103939-9db9-4bb5-943d-2236c81b7820 on hv-cinder-83028 May 25 15:02:51.557943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-2186a722-c5e1-40e7-b279-0c88df71dc49 req-5aadc806-fb1c-4972-acb8-f5c5ad64b3a4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045384 May 25 15:02:51.558381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 428/893] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:02:52.113490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:52.114223 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:52.121374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:52.121880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:52.122765 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:52.123257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:52.267218 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:52.278149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c1bb61ef-caca-4987-b569-542b816bca6c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.166918 May 25 15:02:52.278779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 466/894] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:52 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:53.296625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:53.297357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:53.306622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:53.307113 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:53.308593 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:53.308693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:53.446194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:53.454597 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ebfd198f-955a-41f2-ab46-40e7bb20fd4c tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.163270 May 25 15:02:53.455282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 429/895] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:53 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:54.472195 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:54.472858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:54.479706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:54.488165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:54.488165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:54.488165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:54.654592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:54.654592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-58b5fd82-eb66-4f5d-b57e-16c5b454dac5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.175957 May 25 15:02:54.654592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 467/896] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:54 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:55.669025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:55.669657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:55.676572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:55.677022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:55.677813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:55.678255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:55.864756 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:55.872750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6bf8fbd7-86a7-4fec-bf45-1b31052d2367 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.208246 May 25 15:02:55.873332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 430/897] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:55 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:56.890282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:56.890698 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:56.900132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=6 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:56.900132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:56.900132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:56.900132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:56.900561 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.040167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:57.047801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f110a6d9-d8b7-48c2-afd4-8937e36e390e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.162449 May 25 15:02:57.048374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 468/898] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:56 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:57.896971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-16d279e3-e24b-4869-8a99-55c161cca791 req-dd5a3a18-93b2-45fe-b0c8-1f746074838c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85103939-9db9-4bb5-943d-2236c81b7820", "name": "network-vif-plugged", "status": "completed", "tag": "b4734f99-b653-4271-85f9-99aee86cd902"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:02:57.900968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:57.901813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:57.916824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-16d279e3-e24b-4869-8a99-55c161cca791 req-dd5a3a18-93b2-45fe-b0c8-1f746074838c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:57.917273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-16d279e3-e24b-4869-8a99-55c161cca791 req-dd5a3a18-93b2-45fe-b0c8-1f746074838c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:57.930428 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-16d279e3-e24b-4869-8a99-55c161cca791 req-dd5a3a18-93b2-45fe-b0c8-1f746074838c service nova] Creating event network-vif-plugged:b4734f99-b653-4271-85f9-99aee86cd902 for instance 85103939-9db9-4bb5-943d-2236c81b7820 on hv-cinder-83028 May 25 15:02:57.936954 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-16d279e3-e24b-4869-8a99-55c161cca791 req-dd5a3a18-93b2-45fe-b0c8-1f746074838c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044288 May 25 15:02:57.937973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 431/899] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:02:58.065481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:58.066185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:58.075780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:58.076484 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:58.077285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:58.077731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:58.217440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:58.225639 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c03e23b5-2ed2-49a3-a59b-bd591e8c695e tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.164104 May 25 15:02:58.226228 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 469/900] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:58 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:02:58.589170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:02:58.589526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:02:59.244331 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:02:59.245059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:02:59.252167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.252622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.253387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:02:59.253830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:02:59.256599 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:59.388007 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:02:59.396098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9ba4e5e6-e98f-40f9-b0d0-8e58c7fef3d7 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.156681 May 25 15:02:59.396678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 432/901] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:02:59 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:00.413412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:00.414203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:00.420784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:00.425868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:00.425868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:00.425868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:00.554358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:00.562178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-601ed61c-5a97-4ca9-ad58-04d09acc83df tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1363 microversion: 2.1 time: 0.152725 May 25 15:03:00.562759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 470/902] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:00 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:01.579109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:01.579681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:01.586811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.587264 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.588029 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.588463 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.723177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:01.730942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c07c24ca-f9d5-40f1-983c-b3ea6f0eefd5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1549 microversion: 2.1 time: 0.155763 May 25 15:03:01.731725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 433/903] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:01 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:01.747088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:01.747583 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:01.753948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.754660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.755432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:01.755871 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:01.834746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f3421057-280a-41a0-81a5-f9f531937337 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091546 May 25 15:03:01.835365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 471/904] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 15:03:01 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:02.983078 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-f5fc1b44-066c-4dc8-b555-d40ecc0ba1a2 req-bf19b9cd-421c-44ca-a2f8-c76cb7ba2204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85103939-9db9-4bb5-943d-2236c81b7820", "tag": "b4734f99-b653-4271-85f9-99aee86cd902"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:02.991899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-f5fc1b44-066c-4dc8-b555-d40ecc0ba1a2 req-bf19b9cd-421c-44ca-a2f8-c76cb7ba2204 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:02.992427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-f5fc1b44-066c-4dc8-b555-d40ecc0ba1a2 req-bf19b9cd-421c-44ca-a2f8-c76cb7ba2204 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:03.004227 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-f5fc1b44-066c-4dc8-b555-d40ecc0ba1a2 req-bf19b9cd-421c-44ca-a2f8-c76cb7ba2204 service nova] Creating event network-changed:b4734f99-b653-4271-85f9-99aee86cd902 for instance 85103939-9db9-4bb5-943d-2236c81b7820 on hv-cinder-83028 May 25 15:03:03.009339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-f5fc1b44-066c-4dc8-b555-d40ecc0ba1a2 req-bf19b9cd-421c-44ca-a2f8-c76cb7ba2204 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030567 May 25 15:03:03.009943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 434/905] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:03:12.404989 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.405680 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.409583 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-246776648"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:12.410141 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:12.416442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:12.416886 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:12.417660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:12.418126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:12.542932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.network.security_group_api [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Removing security group 41f109ae-642a-4d23-9aee-0fcb2c42d5d4 from port 8cc89087-34bc-4911-a164-56f942a0863e May 25 15:03:12.982569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8ac8b257-46a5-4224-b837-7e15eb403235 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/action" status: 202 len: 0 microversion: 2.1 time: 0.578947 May 25 15:03:12.983868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 472/906] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:03:12 2022] POST /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:03:12.989715 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.995135 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-f516c3d3-6c8f-44af-8105-80e38bf360fb req-fa7318f5-6220-4f87-a6e1-4ac366484088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:13.003733 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=13 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.007075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-f516c3d3-6c8f-44af-8105-80e38bf360fb req-fa7318f5-6220-4f87-a6e1-4ac366484088 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:13.007273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-f516c3d3-6c8f-44af-8105-80e38bf360fb req-fa7318f5-6220-4f87-a6e1-4ac366484088 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:13.028213 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-f516c3d3-6c8f-44af-8105-80e38bf360fb req-fa7318f5-6220-4f87-a6e1-4ac366484088 service nova] Creating event network-changed:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 15:03:13.036093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-f516c3d3-6c8f-44af-8105-80e38bf360fb req-fa7318f5-6220-4f87-a6e1-4ac366484088 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047691 May 25 15:03:13.038554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 435/907] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:14.320895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:14.321499 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:14.328021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:14.328467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:14.329240 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:14.329673 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:14.412652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lazy-loading 'services' on Instance uuid f221fdda-86ea-483a-b1c8-a28d99ffb993 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:03:14.672109 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ca10d203-ee16-4dc6-92a7-427f4f8c863c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments/a5dba9b7-1425-4450-8dc7-862944e50ec5" status: 202 len: 0 microversion: 2.1 time: 0.355511 May 25 15:03:14.672749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 473/908] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:03:14 2022] DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments/a5dba9b7-1425-4450-8dc7-862944e50ec5 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:03:14.683180 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:14.684335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:14.691754 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:14.692282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:14.693051 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:14.693489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:14.725047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d4090546-27f6-4f12-8c2b-173171452c7f tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047488 May 25 15:03:14.737615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 436/909] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:03:14 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:15.052557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-d9b11d77-2725-45bd-8594-18c9aa7e80b4 req-e6b2bd44-5673-4622-8259-8912b868c771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:15.062272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d9b11d77-2725-45bd-8594-18c9aa7e80b4 req-e6b2bd44-5673-4622-8259-8912b868c771 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:15.062748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d9b11d77-2725-45bd-8594-18c9aa7e80b4 req-e6b2bd44-5673-4622-8259-8912b868c771 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:15.077159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-d9b11d77-2725-45bd-8594-18c9aa7e80b4 req-e6b2bd44-5673-4622-8259-8912b868c771 service nova] Creating event network-changed:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 15:03:15.082110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-d9b11d77-2725-45bd-8594-18c9aa7e80b4 req-e6b2bd44-5673-4622-8259-8912b868c771 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033711 May 25 15:03:15.082937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 474/910] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:15.748590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:15.752837 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:15.756316 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:15.756771 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:15.757575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:15.758010 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:15.788699 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b6365446-2c51-44a8-b460-3cfc99cb493b tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 May 25 15:03:15.789563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 437/911] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:03:15 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:16.801663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:16.802688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:16.809184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:16.809634 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:16.810400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:16.810938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:16.838732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4c3494f9-4131-43af-b4fb-53f70a5092d6 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041831 May 25 15:03:16.839283 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 475/912] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:03:16 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:03:16.849924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:16.850423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:16.857021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:16.857481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:16.858255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:16.858734 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:16.934269 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] HTTP exception thrown: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 is not attached to volume a5dba9b7-1425-4450-8dc7-862944e50ec5 May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Request method failure captured: May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments/a5dba9b7-1425-4450-8dc7-862944e50ec5 HTTP/1.1 May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkQqiS-Ey_dU1xC7S24X4QpslmZXVQgWHnoXBu-jl_jK4MeiqyqR1UV28VqHEVt_82yI3unXEFPAiML0CbPYqfJsGhxneWJNYSbaZIC-znf1l4LvOLZIXpVduyVds6rEbz70Jn2y0prSceJjd3t_3AbJLj4UR4VY8ikcPh9utmY38vM May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: bb0ee163dc0c4237aaa4e2efb85878fc May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-TestMinimumBasicScenario-545981268 May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:03:16.938915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_bb0ee163dc0c4237aaa4e2efb85878fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/bb0ee163dc0c4237aaa4e2efb85878fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bb0ee163dc0c4237aaa4e2efb85878fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bb0ee163dc0c4237aaa4e2efb85878fc"}]}] May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-TestMinimumBasicScenario-545981268 May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: bb0ee163dc0c4237aaa4e2efb85878fc May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-TestMinimumBasicScenario-545981268 May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-TestMinimumBasicScenario-545981268-project May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 479781403bb94b9788fd589f838fea3f May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-TestMinimumBasicScenario-545981268-project May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:03:16.940663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 is not attached to volume a5dba9b7-1425-4450-8dc7-862944e50ec5 May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'server_id': 'f221fdda-86ea-483a-b1c8-a28d99ffb993', 'id': 'a5dba9b7-1425-4450-8dc7-862944e50ec5'} May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a5dba9b7-1425-4450-8dc7-862944e50ec5. May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:16.941524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 is not attached to volume a5dba9b7-1425-4450-8dc7-862944e50ec5 May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 is not attached to volume a5dba9b7-1425-4450-8dc7-862944e50ec5 May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:03:16.943018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Returning 404 to user: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 is not attached to volume a5dba9b7-1425-4450-8dc7-862944e50ec5 {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:16.944154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ff3ab882-1d6d-4949-890f-0e78fe73a7f1 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments/a5dba9b7-1425-4450-8dc7-862944e50ec5" status: 404 len: 154 microversion: 2.1 time: 0.094652 May 25 15:03:16.944154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 438/913] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:03:16 2022] DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993/os-volume_attachments/a5dba9b7-1425-4450-8dc7-862944e50ec5 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:18.327591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:18.328079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:18.334696 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:18.352850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:18.352850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:18.352850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:18.361011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:03:18.797423 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9d4efe83-ee1e-49ba-b680-f61a7daea960 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 204 len: 0 microversion: 2.1 time: 0.473919 May 25 15:03:18.798052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 476/914] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:03:18 2022] DELETE /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:03:18.806089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:18.806980 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:18.813959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:18.814402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:18.815200 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:18.815661 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:18.950049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:18.957908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-201a6bf9-7aa1-49b1-a0eb-2797dd0b105c tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1555 microversion: 2.1 time: 0.155565 May 25 15:03:18.958494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 439/915] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:18 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:19.975831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:19.976538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:19.983104 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.983548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:19.984330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:19.984769 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:20.116474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:20.124025 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a0fb1796-3408-4707-822e-d1fd43c48b2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1555 microversion: 2.1 time: 0.152646 May 25 15:03:20.124613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 477/916] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:19 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:21.141853 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:21.142553 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:21.149365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.149809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:21.150582 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.151070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:21.336536 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:21.345892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a9552ca6-316a-40b5-a596-497405a5ea2a tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1555 microversion: 2.1 time: 0.207891 May 25 15:03:21.346553 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 440/917] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:21 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:21.980913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-197e7ef9-7f78-42b6-9233-f031d458da6a req-ecbbc0fd-6e00-4063-8653-fe17ad9446c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f221fdda-86ea-483a-b1c8-a28d99ffb993", "name": "network-vif-deleted", "tag": "8cc89087-34bc-4911-a164-56f942a0863e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:21.988883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-197e7ef9-7f78-42b6-9233-f031d458da6a req-ecbbc0fd-6e00-4063-8653-fe17ad9446c7 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:21.998089 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-197e7ef9-7f78-42b6-9233-f031d458da6a req-ecbbc0fd-6e00-4063-8653-fe17ad9446c7 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:22.000235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-197e7ef9-7f78-42b6-9233-f031d458da6a req-ecbbc0fd-6e00-4063-8653-fe17ad9446c7 service nova] Creating event network-vif-deleted:8cc89087-34bc-4911-a164-56f942a0863e for instance f221fdda-86ea-483a-b1c8-a28d99ffb993 on hv-cinder-83028 May 25 15:03:22.005405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-197e7ef9-7f78-42b6-9233-f031d458da6a req-ecbbc0fd-6e00-4063-8653-fe17ad9446c7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029377 May 25 15:03:22.005987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 478/918] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:22.363537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:22.365226 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:22.378336 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:22.378994 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:22.379881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:22.380479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:22.443949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479781403bb94b9788fd589f838fea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0ee163dc0c4237aaa4e2efb85878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:22.452562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9bd9b83c-b573-4361-bbe0-aa14d6c65f47 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 200 len: 1343 microversion: 2.1 time: 0.092902 May 25 15:03:22.453284 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 441/919] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:22 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 1343 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:03:23.470915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:23.470915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] [instance: f221fdda-86ea-483a-b1c8-a28d99ffb993] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:23.477432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:23.477881 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:23.478705 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:23.479148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:23.493053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] HTTP exception thrown: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 could not be found. May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Request method failure captured: May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 HTTP/1.1 May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkQqiS-Ey_dU1xC7S24X4QpslmZXVQgWHnoXBu-jl_jK4MeiqyqR1UV28VqHEVt_82yI3unXEFPAiML0CbPYqfJsGhxneWJNYSbaZIC-znf1l4LvOLZIXpVduyVds6rEbz70Jn2y0prSceJjd3t_3AbJLj4UR4VY8ikcPh9utmY38vM May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: bb0ee163dc0c4237aaa4e2efb85878fc May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-TestMinimumBasicScenario-545981268 May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:03:23.495000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_bb0ee163dc0c4237aaa4e2efb85878fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/bb0ee163dc0c4237aaa4e2efb85878fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bb0ee163dc0c4237aaa4e2efb85878fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/bb0ee163dc0c4237aaa4e2efb85878fc"}]}] May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-TestMinimumBasicScenario-545981268 May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: bb0ee163dc0c4237aaa4e2efb85878fc May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-TestMinimumBasicScenario-545981268 May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-TestMinimumBasicScenario-545981268-project May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 479781403bb94b9788fd589f838fea3f May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-TestMinimumBasicScenario-545981268-project May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 could not be found. May 25 15:03:23.497284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'f221fdda-86ea-483a-b1c8-a28d99ffb993'} May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 could not be found. May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:03:23.498146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 could not be found. May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 could not be found. May 25 15:03:23.500192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:03:23.502077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Returning 404 to user: Instance f221fdda-86ea-483a-b1c8-a28d99ffb993 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:03:23.502077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6a415a16-98ef-4132-821f-eda4fe0a5042 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993" status: 404 len: 111 microversion: 2.1 time: 0.031425 May 25 15:03:23.502077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 479/920] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:03:23 2022] GET /compute/v2.1/servers/f221fdda-86ea-483a-b1c8-a28d99ffb993 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:03:23.505889 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ae50b446-472a-4cbd-8e09-2eebc7731195 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] Calling method '.version_select at 0x7f6fb4a1f4c0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:23.647260 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ae50b446-472a-4cbd-8e09-2eebc7731195 tempest-TestMinimumBasicScenario-545981268 tempest-TestMinimumBasicScenario-545981268-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1597081167" status: 202 len: 0 microversion: 2.1 time: 0.145146 May 25 15:03:23.647842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 442/921] 10.222.0.74 () {58 vars in 1271 bytes} [Wed May 25 15:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1597081167 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:03:39.703254 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:39.703784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:39.705936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.706624 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.711351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:39.711807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:39.722029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:39.722029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:39.737308 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1bce84e8-31ca-45db-9688-c8d13d1a6cb4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/ips" status: 200 len: 152 microversion: 2.20 time: 0.038063 May 25 15:03:39.737876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 480/922] 10.222.0.74 () {60 vars in 1288 bytes} [Wed May 25 15:03:39 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:03:43.106840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=38 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:43.107608 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:43.112147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:43.112671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:43.120887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:43.121335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:43.122094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:43.122527 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:43.213572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lazy-loading 'flavor' on Instance uuid 7adffb0a-813f-410e-88eb-e901f068c873 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:03:43.881334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3d57e7f9-fbe9-44ac-bb16-988b7a0a45e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/action" status: 202 len: 0 microversion: 2.20 time: 0.775752 May 25 15:03:43.885420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 443/923] 10.222.0.74 () {62 vars in 1318 bytes} [Wed May 25 15:03:43 2022] POST /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:03:43.893285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:43.894488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:43.906982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:43.907550 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:43.908659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:43.909098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:44.039446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:44.047835 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:44.049451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:44.050624 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-581423d9-d501-4c4f-8ba4-706c1951aa1f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.164113 May 25 15:03:44.051215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 481/924] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:43 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:03:45.071782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:45.072477 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:45.079489 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:45.079941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:45.080710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:45.081182 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:45.297464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:45.305406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:45.307204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:45.308364 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4e141ff8-2e4c-4765-863f-16ecd4d68031 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.241417 May 25 15:03:45.308926 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 444/925] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:45 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:46.327243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:46.327900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:46.334866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:46.335317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:46.336098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:46.336538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:46.468114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:46.476253 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:46.477825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:46.479021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3054562f-2dd6-4894-b9f2-fdb1f104f50b tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.156180 May 25 15:03:46.479580 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 482/926] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:46 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:47.496836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:47.497486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:47.504071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:47.504464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:47.505220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:47.505649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:47.633327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:47.641750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:47.643294 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:47.644450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-77a53f5b-50bb-4c4e-bc60-4038d5ec3df1 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.151537 May 25 15:03:47.645001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 445/927] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:47 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:48.663335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:48.663888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:48.671170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:48.671619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:48.672390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:48.672828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:48.801576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:48.810098 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:48.811642 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:48.812823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-68990fd2-881f-4df2-a5fb-8aa52bd7a922 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.153522 May 25 15:03:48.813379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 483/928] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:48 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:49.831196 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:49.831792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:49.838291 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:49.838774 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:49.839544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:49.839981 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:49.967555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:49.975399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:49.976924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:49.978077 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e152fa40-a227-42d9-87a5-c574d9b06953 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.150898 May 25 15:03:49.978662 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 446/929] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:49 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:50.996827 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:50.997352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:51.004121 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:51.011433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:51.011433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:51.011433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:51.135655 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:51.144030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:51.145546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:51.146734 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bfb8d5e1-4afa-4144-9d45-f0d5427b0f2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.153917 May 25 15:03:51.147296 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 484/930] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:50 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:52.165397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:52.166009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:52.172220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:52.172667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:52.173431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:52.173871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:52.304546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:52.313318 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:52.314870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:52.316148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9fdebcd0-f483-4a1b-8de7-483f1cfd80b4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.154741 May 25 15:03:52.316705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 447/931] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:52 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:52.537675 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:52.538268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:52.545386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:52.545832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:52.546689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:52.547301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:52.571274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d1fd12b4-4a92-43bf-86f6-98dbc33665be tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/ips" status: 200 len: 150 microversion: 2.1 time: 0.037659 May 25 15:03:52.571778 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 485/932] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 15:03:52 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:53.343061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:53.343061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:53.343061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:53.343061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:53.344629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:53.344629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:53.480288 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:53.481408 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:53.482964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:53.484165 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f8de925f-cb0f-49fb-a53d-91260e8d704c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.153743 May 25 15:03:53.484730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 448/933] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:53 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:54.503257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:54.503842 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:54.510213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:54.510691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:54.511462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:54.511898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:54.639877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:54.648197 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:54.649711 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:54.651026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-eb3785a3-603e-4b75-bffb-73120455337f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.151746 May 25 15:03:54.652057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 486/934] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:54 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:55.323366 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a127aa89-e1af-4226-ac6d-513ae7ce63bc"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:03:55.325874 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:55.337807 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:55.338398 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:55.339713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:55.340818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:55.670332 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:55.672496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:55.681875 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:55.682758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:55.683665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:55.684416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:55.835909 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:55.844832 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:55.846359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:55.847590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-68a81b72-91b6-4112-84c0-0f81cc25e3f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.182006 May 25 15:03:55.848173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 487/935] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:55 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:56.390190 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9710fbae-ecf4-424a-a626-983a0ebd4851 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.072869 May 25 15:03:56.390933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 449/936] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:03:55 2022] POST /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments => generated 194 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:03:56.867294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:56.867963 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:56.875180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:56.875669 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:56.876472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:56.876926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:57.008139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:57.018054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:57.018967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:57.020233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-31ff2a06-1e50-4181-8285-3ae61fd2eab7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1744 microversion: 2.20 time: 0.157084 May 25 15:03:57.020829 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 488/937] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:56 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:58.041058 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:58.041756 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:58.049441 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:58.049910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:58.050729 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:58.051172 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:58.198230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:58.206878 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:58.208427 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:58.209601 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1c4bc159-6ec1-4cd6-a14f-f808ac83ca1a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1744 microversion: 2.20 time: 0.173477 May 25 15:03:58.210151 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 450/938] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:58 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:03:59.228229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:03:59.228888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:03:59.235654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:59.236111 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:59.236892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:03:59.237340 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:03:59.374390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:59.382352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:59.383898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:03:59.385078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a13e1be5-c9ab-4bc4-a1bc-18634edce3e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1744 microversion: 2.20 time: 0.160784 May 25 15:03:59.385635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 489/939] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:03:59 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:00.134508 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-e2e554c2-0e38-400e-9d26-c9d5fef73897 req-b47c85f4-b766-44e8-a43c-7ee75e01e2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "name": "network-vif-plugged", "status": "completed", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:00.143844 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e2e554c2-0e38-400e-9d26-c9d5fef73897 req-b47c85f4-b766-44e8-a43c-7ee75e01e2e2 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:00.144295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e2e554c2-0e38-400e-9d26-c9d5fef73897 req-b47c85f4-b766-44e8-a43c-7ee75e01e2e2 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:00.156487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-e2e554c2-0e38-400e-9d26-c9d5fef73897 req-b47c85f4-b766-44e8-a43c-7ee75e01e2e2 service nova] Creating event network-vif-plugged:d0275964-ead5-40f3-93a4-63cb2514a0ae for instance 7adffb0a-813f-410e-88eb-e901f068c873 on hv-cinder-83028 May 25 15:04:00.161451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-e2e554c2-0e38-400e-9d26-c9d5fef73897 req-b47c85f4-b766-44e8-a43c-7ee75e01e2e2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030709 May 25 15:04:00.162146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 451/940] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:00.405045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:00.405676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:00.412631 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:00.413078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:00.413860 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:00.414296 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:00.547126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:00.555157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:00.559897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:00.559897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e6309682-2e57-4ace-a5c9-8828e07de7dc tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1744 microversion: 2.20 time: 0.157775 May 25 15:04:00.559897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 490/941] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:00 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:01.577993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:01.578714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:01.585713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:01.586162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:01.586977 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:01.587416 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:01.716443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:01.724460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:01.726026 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:01.727220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-49942cbf-2d91-40ba-ac9e-a732fa42ab86 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1744 microversion: 2.20 time: 0.154042 May 25 15:04:01.727763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 452/942] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:01 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:02.745177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:02.745990 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:02.752640 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:02.753088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:02.753853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:02.754286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:02.885663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:02.893935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:02.895488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:02.898834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-09d2615b-bb5c-4d78-8d15-7ff149fff25e tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1744 microversion: 2.20 time: 0.155373 May 25 15:04:02.898834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 491/943] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:02 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:03.915178 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:03.915823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:03.923534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:03.923983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:03.924763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:03.925204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:04.064884 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:04.072860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:04.089760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:04.089760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-135d83d9-8490-4ecd-b241-0c6c073bc255 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.164884 May 25 15:04:04.089760 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 453/944] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:03 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:05.000898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a127aa89-e1af-4226-ac6d-513ae7ce63bc"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:05.002045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:05.008760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.009466 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.010468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.010940 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.094675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:05.096333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:05.108528 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.109032 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.109902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.110755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.139146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Invalid volume: volume a127aa89-e1af-4226-ac6d-513ae7ce63bc is already attached to instances: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: POST /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments HTTP/1.1 May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 74 May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:04:05.141311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {"volumeAttachment": {"volumeId": "a127aa89-e1af-4226-ac6d-513ae7ce63bc"}} May 25 15:04:05.142820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Invalid volume: volume a127aa89-e1af-4226-ac6d-513ae7ce63bc is already attached to instances: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'server_id': '4981ccf8-2f23-4afd-a4e3-db0a929a1e1e', 'body': {'volumeAttachment': {'volumeId': 'a127aa89-e1af-4226-ac6d-513ae7ce63bc'}}} May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a127aa89-e1af-4226-ac6d-513ae7ce63bc is already attached to instances: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:05.143689 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a127aa89-e1af-4226-ac6d-513ae7ce63bc is already attached to instances: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:05.144893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:05.146101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:05.146101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:05.146101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:05.146101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a127aa89-e1af-4226-ac6d-513ae7ce63bc is already attached to instances: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e May 25 15:04:05.146101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:05.148202 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 400 to user: Invalid volume: volume a127aa89-e1af-4226-ac6d-513ae7ce63bc is already attached to instances: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:05.149149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7cb4e262-ae56-4c83-89ef-4e374e412522 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152952 May 25 15:04:05.149763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 492/945] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:04:04 2022] POST /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:04:05.227899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:05.229391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:05.236950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.237807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.239256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.239883 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.314257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:05.324126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:05.325967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:05.327887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-442c665f-e463-44f0-b9a2-e041837c83d2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.238020 May 25 15:04:05.341205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 454/946] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:05 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:05.367783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lazy-loading 'services' on Instance uuid 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:04:05.604184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5ff8d478-9264-49e0-83b5-3730253ac7ee tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments/a127aa89-e1af-4226-ac6d-513ae7ce63bc" status: 202 len: 0 microversion: 2.1 time: 0.381268 May 25 15:04:05.605055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 493/947] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:04:05 2022] DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments/a127aa89-e1af-4226-ac6d-513ae7ce63bc => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:04:05.616346 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:05.617307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:05.629702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.630380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.633084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:05.633754 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:05.687735 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-94c08c69-d43a-4ade-881f-6b4feaca2192 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076708 May 25 15:04:05.688482 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 455/948] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:04:05 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:06.348823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:06.350165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:06.358008 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.361795 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.361795 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.361795 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.520750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:06.530027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:06.531666 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:06.533434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8c316fd0-81b1-47d7-853b-c7534537d97a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.189674 May 25 15:04:06.534062 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 494/949] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:06 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:06.702792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:06.705187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:06.712255 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.712950 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.713908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:06.714507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:06.741700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.746614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a5d51634-dbb1-4dfb-8b4f-66755f77b3aa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050268 May 25 15:04:06.748405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 456/950] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:04:06 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:07.552478 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:07.553275 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:07.560320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.560780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.561601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.562051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.694744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:07.703613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:07.705306 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:07.706531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-13652525-2dcf-4cd8-ab54-5190329c5fa4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.158077 May 25 15:04:07.707115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 495/951] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:07 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:07.759420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:07.760318 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:07.768124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.768581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.769355 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.769853 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.799868 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-139c8a32-f9a4-498d-822f-218fc8082162 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044582 May 25 15:04:07.800429 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 457/952] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:04:07 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:04:07.860960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:07.861482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:07.867813 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.868266 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.869044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:07.869513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:07.888327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.897247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:04:08.359915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-578773ce-29ab-47d9-9cb4-0c4edecc52da tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 204 len: 0 microversion: 2.1 time: 0.503249 May 25 15:04:08.360827 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 496/953] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:04:07 2022] DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:04:08.368931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:08.371430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:08.380112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:08.380567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:08.381342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:08.381779 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:08.552997 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:08.563249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-771cb414-b59c-4b19-898a-b914a936fe56 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1681 microversion: 2.1 time: 0.198098 May 25 15:04:08.564580 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 458/954] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:08 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:08.733557 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:08.734980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:08.742651 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:08.743142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:08.743976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:08.744445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:08.902368 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:08.916615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:08.919493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:08.921680 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-27da7367-ac2d-43a9-91a9-114739f86ec6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.192891 May 25 15:04:08.922434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 497/955] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:08 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:09.582806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:09.583640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:09.591329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:09.592075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:09.593131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:09.593967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:09.760541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:09.770499 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-23feb3ce-ce13-43be-b2ef-cd735b5d83ef tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1681 microversion: 2.1 time: 0.191785 May 25 15:04:09.771222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 459/956] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:09 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:09.941059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:09.941609 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:09.948563 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:09.949269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:09.950068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:09.950682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.106928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:10.115879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:10.117735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:10.119351 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cf804442-8dd5-46a4-b07b-296c0892ffb7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.182258 May 25 15:04:10.120903 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 498/957] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:09 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:10.789015 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:10.789597 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:10.802475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:10.807118 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.808908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:10.809386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:10.987808 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:11.001996 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-31397e02-6df4-4364-b9d9-657b1d2d88d3 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1681 microversion: 2.1 time: 0.217932 May 25 15:04:11.003035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 460/958] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:10 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:11.147014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:11.147732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:11.158163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:11.159213 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:11.160255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:11.160919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:11.310038 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:11.318348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:11.319924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:11.321085 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-17667362-a557-42c4-b2c4-d28e037c2915 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.179675 May 25 15:04:11.321644 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 499/959] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:11 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:12.020301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:12.022172 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:12.031822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.032770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.033818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.034478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.103076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:12.125798 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-628ecfc3-4abc-4dbe-8daf-58e48f433737 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1614 microversion: 2.1 time: 0.107924 May 25 15:04:12.137398 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 461/960] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:12 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:12.171764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-6416b154-7305-48bd-965d-9d56783978bd req-5b6004a0-4c7f-4c98-96c0-2ea6354d5807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4981ccf8-2f23-4afd-a4e3-db0a929a1e1e", "name": "network-vif-deleted", "tag": "ba4333a4-99f9-467e-bb63-59997fdfcdcc"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:12.182963 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-6416b154-7305-48bd-965d-9d56783978bd req-5b6004a0-4c7f-4c98-96c0-2ea6354d5807 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.183737 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-6416b154-7305-48bd-965d-9d56783978bd req-5b6004a0-4c7f-4c98-96c0-2ea6354d5807 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.196975 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-6416b154-7305-48bd-965d-9d56783978bd req-5b6004a0-4c7f-4c98-96c0-2ea6354d5807 service nova] Creating event network-vif-deleted:ba4333a4-99f9-467e-bb63-59997fdfcdcc for instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e on hv-cinder-83028 May 25 15:04:12.203530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-6416b154-7305-48bd-965d-9d56783978bd req-5b6004a0-4c7f-4c98-96c0-2ea6354d5807 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035884 May 25 15:04:12.209124 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 500/961] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:12.344343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:12.347639 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:12.355335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.355783 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.368144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:12.369156 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:12.618755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:12.631928 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:12.633968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:12.636497 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5400505f-be87-400a-a379-2b4c951430c7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.300864 May 25 15:04:12.637547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 462/962] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:12 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:13.147992 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:13.149626 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:13.159727 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.160488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.162096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.162721 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.215412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.217060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.217667 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lazy-loading 'fault' on Instance uuid 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:04:13.273718 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:13.282842 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a0e90cea-fed2-4d3a-a4eb-10e4be63e2db tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 200 len: 1331 microversion: 2.1 time: 0.141668 May 25 15:04:13.283782 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 501/963] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:13 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:13.655020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:13.656222 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:13.659933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=41 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:13.663974 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.664704 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.665862 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:13.666518 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:13.839706 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:13.849669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:13.852588 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:13.854052 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1e7031da-b2bb-4bdc-9d1a-ea71106ed2a7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.203950 May 25 15:04:13.854906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 463/964] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:13 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:14.300103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:14.300742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:14.303205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:14.308586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.309052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.310401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.311041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.329371 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e HTTP/1.1 May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:04:14.331405 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:04:14.332997 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '4981ccf8-2f23-4afd-a4e3-db0a929a1e1e'} May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:04:14.333762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:04:14.335421 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:04:14.337923 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:04:14.338837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7c0d67ff-ae62-4e09-87ed-4eed5d7c874b tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 404 len: 111 microversion: 2.1 time: 0.042602 May 25 15:04:14.339407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 502/965] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:14 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:04:14.348348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9c11ec28-e23e-4980-8d49-fe902e3afff9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '.version_select at 0x7f6fb4879d30>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:14.449533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9c11ec28-e23e-4980-8d49-fe902e3afff9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767229441" status: 202 len: 0 microversion: 2.1 time: 0.104979 May 25 15:04:14.450841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 464/966] 10.222.0.74 () {58 vars in 1220 bytes} [Wed May 25 15:04:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767229441 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:04:14.878791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:14.880516 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:14.888704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.889583 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:14.890892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:14.891451 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:15.050178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:15.061392 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:15.063173 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:15.064592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-19f1ae7e-4298-45ab-99cf-7b0b697630c9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.195020 May 25 15:04:15.075749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 503/967] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:14 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:16.062900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-94b82e78-3a8e-4659-9be7-3d77a3a11a79 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: .version_select at 0x7f6fb4860040>, body: {"keypair": {"name": "tempest-keypair-1589977749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp78p1LQEVJLp8L6HyxTvBaQ0TvYe+4S8/l0DWqGVc3H/cGBSQj6muh/nmQShfyt2XKwib+/VBQ1kgTCLDNwRxP8FWnKRnv5UUXgVWYpFjrN/NIJ4Ooow36oogu5Ju3RA=="}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:16.079219 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-94b82e78-3a8e-4659-9be7-3d77a3a11a79 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:04:16.083850 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-94b82e78-3a8e-4659-9be7-3d77a3a11a79 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'key_pairs'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:04:16.085601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:16.086292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:16.093204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:16.093945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:16.094871 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:16.095394 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:16.238135 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:16.249183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:16.251188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:16.255926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2a40e953-00a5-41f2-8d08-6c2bdd6d7b3c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.171596 May 25 15:04:16.255926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 504/968] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:16 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:16.262010 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-94b82e78-3a8e-4659-9be7-3d77a3a11a79 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204185 May 25 15:04:16.262697 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 465/969] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 15:04:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:17.275910 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:17.276525 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:17.284593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:17.284593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:17.284593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:17.284957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:17.422518 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:17.430628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:17.432164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:17.433586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-28fb9856-b56f-4a62-ae7a-19dbf6bcae19 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.161673 May 25 15:04:17.434143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 505/970] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:17 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:18.453124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:18.454430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:18.461424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.462131 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.463181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:18.463823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:18.601783 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:18.610174 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:18.611571 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:18.612763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ba5e41c3-f23b-42f3-bf0b-d23aa6095065 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1739 microversion: 2.20 time: 0.164316 May 25 15:04:18.613585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 466/971] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:18 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:19.632597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:19.634267 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:19.641733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.642401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.643366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:19.643872 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:19.786799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:19.797123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:19.799504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:19.810974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-800b3fce-8f85-407c-9da4-faabf702738a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1721 microversion: 2.20 time: 0.172706 May 25 15:04:19.810974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 506/972] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:19 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:19.874134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1876491147", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa952598-36d5-42ef-b4ac-0f4017a94969"}], "security_groups": [{"name": "tempest-securitygroup--564665460"}], "key_name": "tempest-keypair-1589977749", "user_data": "}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:19.973854 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] validate_networks() for [('fa952598-36d5-42ef-b4ac-0f4017a94969', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:04:20.338064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:04:20.338487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:04:20.338992 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:04:20.339397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:04:20.339842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:04:20.349295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:20.349745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:20.350548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:20.351036 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:20.367348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:04:20.371316 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Getting quotas for user cd25c0ad8e1c4fa08eca9b6bddeca55d and project c86222a9c32a4f77878dc82c40e38ff1. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:04:20.382454 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:04:20.384744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:04:20.545773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-927c36ff-d181-4a79-ba6d-72f9a2101064 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676126 May 25 15:04:20.546425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 467/973] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:04:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:04:20.556401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef377563-1a26-4545-aec7-b8927e8c62b7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:20.557016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ef377563-1a26-4545-aec7-b8927e8c62b7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:20.608725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ef377563-1a26-4545-aec7-b8927e8c62b7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.615374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ef377563-1a26-4545-aec7-b8927e8c62b7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1242 microversion: 2.1 time: 0.062945 May 25 15:04:20.615938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 507/974] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:20 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:20.827839 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:20.828450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:20.835307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:20.835759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:20.836537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:20.836972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:20.965167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.974001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.975557 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:20.976750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e6064971-ac79-4648-9aa5-1b050ff84930 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1721 microversion: 2.20 time: 0.152923 May 25 15:04:20.977361 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 468/975] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:20 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:21.632729 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-55bd894e-7bdf-43b8-a21e-04314abab2a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:21.633347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-55bd894e-7bdf-43b8-a21e-04314abab2a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:21.687315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-55bd894e-7bdf-43b8-a21e-04314abab2a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:21.694576 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-55bd894e-7bdf-43b8-a21e-04314abab2a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1242 microversion: 2.1 time: 0.065698 May 25 15:04:21.699815 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 508/976] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:21 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:21.997373 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:21.997373 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:22.003126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.003556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:22.004327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.004768 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:22.136251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:22.145512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:22.147075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:22.148253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7e21a071-0a46-4d16-81c4-0efa0a4ffff4 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1724 microversion: 2.20 time: 0.156391 May 25 15:04:22.148844 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 469/977] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:21 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:22.167352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4930ef82-cad9-450b-9964-dcdd492befd1"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:22.168502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:22.174668 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.175134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:22.175987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.176427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:22.216660 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-4988f05c-6cd4-4da5-b28f-f5035cce5b40 req-1c637557-38c3-4726-bfb9-5dc158db62c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "name": "network-vif-unplugged", "status": "completed", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:22.225233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-4988f05c-6cd4-4da5-b28f-f5035cce5b40 req-1c637557-38c3-4726-bfb9-5dc158db62c5 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:22.225679 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-4988f05c-6cd4-4da5-b28f-f5035cce5b40 req-1c637557-38c3-4726-bfb9-5dc158db62c5 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:22.236799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.compute.server_external_events [req-4988f05c-6cd4-4da5-b28f-f5035cce5b40 req-1c637557-38c3-4726-bfb9-5dc158db62c5 service nova] Unable to find a host for instance 7adffb0a-813f-410e-88eb-e901f068c873. Dropping event network-vif-unplugged {{(pid=129907) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 15:04:22.237696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-4988f05c-6cd4-4da5-b28f-f5035cce5b40 req-1c637557-38c3-4726-bfb9-5dc158db62c5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025496 May 25 15:04:22.238291 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 470/978] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 25 15:04:22.712130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-af8dfb88-cec6-4ec9-8bba-14c133fb4d68 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:22.712832 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-af8dfb88-cec6-4ec9-8bba-14c133fb4d68 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:22.768783 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-af8dfb88-cec6-4ec9-8bba-14c133fb4d68 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:22.775445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-af8dfb88-cec6-4ec9-8bba-14c133fb4d68 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1242 microversion: 2.1 time: 0.067455 May 25 15:04:22.776007 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 471/979] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:22 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:23.780503 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f91e6be1-c1b7-4a8e-bac3-92cff72447c5 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.617324 May 25 15:04:23.781140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 509/980] 10.222.0.74 () {62 vars in 1363 bytes} [Wed May 25 15:04:22 2022] POST /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-volume_attachments => generated 188 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 15:04:23.792021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4a8dd944-ab2b-4a88-a96e-e21ff13038a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:23.792704 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4a8dd944-ab2b-4a88-a96e-e21ff13038a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:23.845352 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4a8dd944-ab2b-4a88-a96e-e21ff13038a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:23.853049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4a8dd944-ab2b-4a88-a96e-e21ff13038a2 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1242 microversion: 2.1 time: 0.064904 May 25 15:04:23.853703 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 472/981] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:23 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:23.899440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:23.899942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:23.907272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:23.907719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:23.908494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:23.908939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.134890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.800644 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-94b11077-5d81-4b70-9f64-bef2de1b1d82 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-volume_attachments/4930ef82-cad9-450b-9964-dcdd492befd1" status: 202 len: 0 microversion: 2.20 time: 0.905184 May 25 15:04:24.802300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 510/982] 10.222.0.74 () {60 vars in 1456 bytes} [Wed May 25 15:04:23 2022] DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-volume_attachments/4930ef82-cad9-450b-9964-dcdd492befd1 => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:04:24.857286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:24.858133 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:24.864935 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:24.865475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.866253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:24.866718 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.869391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:24.870000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:24.879355 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:24.879800 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.880571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:24.881005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:24.944369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:24.952356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f17369fd-88f7-4411-81af-2d2a982445b6 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1246 microversion: 2.1 time: 0.086794 May 25 15:04:24.952930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 511/983] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:24 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:25.222232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e1ab7094-2bdc-49e2-8b15-506dc01b551c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "POST /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/action" status: 202 len: 0 microversion: 2.20 time: 0.368787 May 25 15:04:25.222888 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 473/984] 10.222.0.74 () {62 vars in 1318 bytes} [Wed May 25 15:04:24 2022] POST /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 15:04:25.231175 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:25.231789 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:25.238065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:25.238513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:25.239391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:25.239833 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:25.371416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:25.380118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:25.381659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:25.382862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e9aa19c0-68a7-4b12-8073-989548765b33 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1672 microversion: 2.20 time: 0.155556 May 25 15:04:25.383434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 512/985] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:25 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:25.969645 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:25.970479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:25.976816 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:25.977258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:25.978031 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:25.978460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:26.051954 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:26.059787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f6de04df-f6ce-4401-9a31-8ba684a4d3c5 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1246 microversion: 2.1 time: 0.094401 May 25 15:04:26.060424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 474/986] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:25 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:26.403419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:26.404023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:26.410823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:26.411493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:26.412274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:26.412715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:26.540246 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:26.549594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:26.551216 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:26.553142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f0d8f8cb-bf31-4146-aabf-a61abd6d8e43 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1672 microversion: 2.20 time: 0.155483 May 25 15:04:26.553712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 513/987] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:26 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:27.077870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:27.078484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:27.084973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:27.085425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:27.086217 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:27.086683 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:27.150934 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.158490 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-15bfc151-2c72-4070-b941-d82fb6d3f5bb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1294 microversion: 2.1 time: 0.085499 May 25 15:04:27.159093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 475/988] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:27 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:27.571741 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:27.572504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:27.579080 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:27.579539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:27.580349 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:27.581073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:27.712944 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.721490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.723125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:27.724315 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8d179d6f-6e62-4b9b-b5e6-767a370b476a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1674 microversion: 2.20 time: 0.156544 May 25 15:04:27.724876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 514/989] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:27 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:28.175965 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:28.176583 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:28.183911 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:28.184605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:28.188745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:28.188745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:28.319520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.328368 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f37d9947-90f4-4538-82cd-c661f4bb5608 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.156298 May 25 15:04:28.328952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 476/990] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:28 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:28.751837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:28.752429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:28.759271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:28.759725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:28.760519 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:28.760959 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:28.900831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.909000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.910538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:28.911763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-50648ca3-9c1b-4141-919c-3f4a193d3594 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.164608 May 25 15:04:28.912330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 515/991] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:28 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:29.345971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:29.346590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:29.353339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:29.353729 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:29.354516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:29.354993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:29.485329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:29.489242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:29.493573 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a75765d1-6004-42a0-9023-a2f3d5957e42 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.151921 May 25 15:04:29.494150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 477/992] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:29 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:29.930456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:29.931759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:29.938454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:29.939033 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:29.939709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:29.940151 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:30.030295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-e38edbda-301d-438c-a969-63c90fe99c0a req-68fd7ac4-93ca-4e9f-955a-f5c56d05019f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "631dc815-ce7a-40b3-9bdb-35f04b2fca01", "tag": "f7072705-f1db-4bc8-a3d5-6e626bab50e6"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:30.039458 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e38edbda-301d-438c-a969-63c90fe99c0a req-68fd7ac4-93ca-4e9f-955a-f5c56d05019f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:30.039970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e38edbda-301d-438c-a969-63c90fe99c0a req-68fd7ac4-93ca-4e9f-955a-f5c56d05019f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:30.052702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-e38edbda-301d-438c-a969-63c90fe99c0a req-68fd7ac4-93ca-4e9f-955a-f5c56d05019f service nova] Creating event network-changed:f7072705-f1db-4bc8-a3d5-6e626bab50e6 for instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 on hv-cinder-83028 May 25 15:04:30.065824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-e38edbda-301d-438c-a969-63c90fe99c0a req-68fd7ac4-93ca-4e9f-955a-f5c56d05019f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042091 May 25 15:04:30.066682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 478/993] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:30.109560 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.129127 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.136981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.138976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-79c8d278-5579-4257-a3f4-6e35dd1f2265 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.211949 May 25 15:04:30.140146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 516/994] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:29 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:30.510239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.520446 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:30.527089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:30.532667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:30.534569 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:30.535711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:30.536319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:30.683466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:30.691047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5dfbcea4-3774-4d71-9893-f5cccc5c2406 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.182983 May 25 15:04:30.691860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 479/995] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:30 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:31.157879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:31.158488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:31.165467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:31.166002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:31.166816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:31.167399 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:31.306347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.316072 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.319287 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.320508 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bc690e4d-7b5c-4b49-bbac-a8b49dabc7c3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.167089 May 25 15:04:31.321068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 517/996] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:31 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:31.708810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:31.710465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:31.719371 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:31.720346 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:31.721542 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:31.722273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:31.879080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:31.887266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b443080a-2566-402b-8386-08542b16305d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.182652 May 25 15:04:31.888182 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 480/997] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:31 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:32.339741 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:32.340359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:32.342987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=4 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:32.348460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.354676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:32.354676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.354676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:32.494904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:32.503461 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:32.504973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:32.506150 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a56df852-5e83-4f53-99e1-d2f7ac64e3e2 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.170406 May 25 15:04:32.517010 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 518/998] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:32 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:32.579864 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:32.580362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:32.586673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.588130 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:32.588977 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.589397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:32.616176 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-56c8556d-c7b8-4a57-8842-f753da2b59aa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/ips" status: 200 len: 146 microversion: 2.1 time: 0.040695 May 25 15:04:32.616752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 481/999] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 15:04:32 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:32.908134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:32.908748 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:32.915191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.916594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:32.918183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:32.918890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:33.065345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.073951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c7fcc9c0-5349-4ad4-93f0-b722d9c064b8 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.169627 May 25 15:04:33.074543 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 519/1000] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:32 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:33.525179 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:33.525740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:33.533168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:33.533622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:33.534393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:33.534897 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:33.691280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.701084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.704163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:33.704163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d2267abb-c1e3-430c-b70d-3bada09928e7 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.183015 May 25 15:04:33.707101 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 482/1001] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:33 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:34.092746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:34.093344 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:34.101391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:34.101391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:34.101391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:34.101391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:34.308199 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.316191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-447d53d0-40f6-4b16-aa25-464307e09d1f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.228401 May 25 15:04:34.316752 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 520/1002] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:34 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:34.723276 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:34.724000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:34.725840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=14 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:34.731588 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:34.732046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:34.733347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:34.733786 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:34.898406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.907167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.909053 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:34.910780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fd589cdd-fba4-4518-8faf-5025b6704a00 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.191564 May 25 15:04:34.911776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 483/1003] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:34 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:35.336589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:35.337352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:35.344724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.345248 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.346096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.346598 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.446343 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c3ce182-6bce-42c0-bd8f-946878ed79fd"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:35.447271 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:35.454852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.455675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.456093 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.456534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.497781 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:35.505866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e874a5dc-cf82-4578-8a87-0a8119e17723 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.175704 May 25 15:04:35.508528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 521/1004] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:35 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:35.929536 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:35.930060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:35.936887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.937323 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:35.938084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:35.938622 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:36.082042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.090768 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.092691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.095430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6b5b2cd1-e20c-4edc-ac00-9ff3d7ec69a3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.168728 May 25 15:04:36.095430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 522/1005] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:35 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:36.523270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:36.538276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:36.538276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:36.538276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:36.538276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:36.538717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:36.687242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:36.688271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fe89d587-5c38-4e18-96fd-a124c6d8c83a tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.168962 May 25 15:04:36.689207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 523/1006] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:36 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:37.113496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:37.122521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:37.122521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.122521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:37.122521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.122921 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:37.274743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:37.283418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:37.284966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:37.286183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a97b4cc0-6b8b-4b4f-bb91-23f76c79a1da tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.176723 May 25 15:04:37.286772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 524/1007] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:37 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:37.705715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:37.706468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:37.713242 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.713584 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:37.714385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:37.714852 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:37.864432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:37.872507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2012e3ca-6029-45d3-ae38-908408256267 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.170757 May 25 15:04:37.876909 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 525/1008] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:37 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:38.305455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:38.306214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:38.318411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:38.318960 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:38.319808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:38.320320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:38.323262 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:38.462165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:38.472048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:38.473584 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:38.474996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5b7272e3-26f6-481d-8c9d-9c4a96a0bfd0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.174282 May 25 15:04:38.475563 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 526/1009] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:38 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:38.893265 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:38.893888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:38.900521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:38.900975 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:38.901847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:38.902282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:39.035386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.043112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c0504c90-31eb-4871-ad2a-31f11f4f04ad tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.154980 May 25 15:04:39.043682 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 527/1010] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:38 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:39.493515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:39.494170 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:39.500798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:39.501250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:39.502021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:39.502464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:39.633685 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.642290 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.643848 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:39.645072 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-78b4dd34-0f7e-4d81-862a-caf8bb8e6ce0 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.155633 May 25 15:04:39.645572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 528/1011] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:39 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:40.060445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:40.061747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:40.068197 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:40.068645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:40.069416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:40.069907 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:40.202348 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.210068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b574a514-fadc-4f68-93b3-fcaf0e6e5690 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.153829 May 25 15:04:40.210659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 529/1012] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:40 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:40.663393 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:40.664114 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:40.670543 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:40.671011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:40.671771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:40.672205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:40.798937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.807283 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.809045 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:40.810294 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6122f573-3d13-4a78-a810-45ea14462c92 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.150852 May 25 15:04:40.811515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 530/1013] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:40 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:41.226837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:41.227488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:41.234572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:41.235048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:41.235816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:41.236254 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:41.366219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.373681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1f682be3-571d-469d-a56e-82b2adb91582 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.150722 May 25 15:04:41.374250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 531/1014] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:41 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:41.829413 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:41.829947 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:41.836103 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:41.836556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:41.837331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:41.837770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:41.966336 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.974337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.975934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:41.977110 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-89bbaace-b9d8-490d-a4d1-0a28daec0815 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.152304 May 25 15:04:41.977678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 532/1015] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:41 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:42.390700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:42.391328 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:42.397848 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:42.398293 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:42.399081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:42.399523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:42.525058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:42.533001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cf57cc30-7fba-4078-97d5-89fa14210be0 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.146153 May 25 15:04:42.533572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 533/1016] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:42 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:42.995044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:42.995656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:43.002136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:43.002585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:43.003382 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:43.003819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:43.133900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.142065 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.143629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.144799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-52e26bf5-c4c8-4dce-b74d-94576272e916 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.153882 May 25 15:04:43.145365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 534/1017] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:42 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:43.550222 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:43.550897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:43.557307 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:43.557759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:43.558830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:43.559277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:43.685676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:43.693233 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d0508d31-6de0-4e2c-b17e-65d205de3584 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.147740 May 25 15:04:43.693814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 535/1018] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:43 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:44.164056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:44.164955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:44.171937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:44.172556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:44.173385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:44.173912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:44.335180 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.344882 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.346517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.347768 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-de096190-4985-450e-bf73-660fcf38883d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.188281 May 25 15:04:44.348585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 536/1019] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:44 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:44.710611 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:44.711317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:44.717782 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:44.718225 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:44.719025 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:44.719457 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:44.847948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:44.855404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-081f2a11-430a-4eed-ac98-29c699695414 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.148641 May 25 15:04:44.855975 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 537/1020] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:44 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:45.108494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:04:45.108744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:04:45.366015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:45.366565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:45.372717 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:45.373217 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:45.373987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:45.374424 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:45.454967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:45.500985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:45.508935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:45.510462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:45.511671 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e356c9f7-37d0-44dd-85ba-d224ecc8fbcb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.149723 May 25 15:04:45.512231 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 538/1021] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:45 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:45.564337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=36 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:45.961134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:45.961862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:45.970145 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:45.970949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:45.971575 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:45.972011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:46.113340 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.120877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-03ee63b9-6ee0-490d-95f7-922eac713ab7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.252624 May 25 15:04:46.121446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 539/1022] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:45 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:04:46.530596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:46.531258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:46.533141 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=80 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:46.537892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:46.538341 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:46.539214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:46.539649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:46.667442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.675932 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.677431 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:46.678589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0b22fcb5-16a1-4ac9-b108-f3d7a2367351 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.152073 May 25 15:04:46.679165 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 540/1023] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:46 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:46.754799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cab4e1fd-8931-4c37-ae0c-ba16bbdc24bf tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.312376 May 25 15:04:46.755410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 484/1024] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:04:35 2022] POST /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments => generated 194 bytes in 11314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:47.137696 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:47.138308 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:47.145133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:47.145680 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:47.146600 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:47.147099 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:47.276900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:47.285158 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f740f66c-20e0-42cf-ae13-e5218f464038 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.151306 May 25 15:04:47.285725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 541/1025] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:47 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:47.697953 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:47.698712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:47.706242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:47.706730 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:47.707547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:47.707989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:47.840253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:47.849324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:47.850983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:47.852310 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9570592b-0d4b-4f4f-9a8b-9ac66b4d8a94 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.158632 May 25 15:04:47.853220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 485/1026] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:47 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:48.302659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:48.303280 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:48.310159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:48.310612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:48.311416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:48.311862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:48.448767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:48.448767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=100 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:48.453412 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4e956639-9e84-4c98-988a-b98122aabd57 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.154759 May 25 15:04:48.453984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 542/1027] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:48 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:48.870629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:48.871279 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:48.877788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:48.878241 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:48.879066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:48.879509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:49.013495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.022468 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.025084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.025392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fa928428-657b-4859-8d63-d0ab49550003 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.158580 May 25 15:04:49.026217 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 486/1028] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:48 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:49.469481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:49.470102 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:49.477219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:49.477670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:49.478485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:49.478952 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:49.604520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:49.612805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6b6f78ae-7179-4f98-9fcf-5001d5106b0f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.147261 May 25 15:04:49.613383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 543/1029] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:49 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:50.044540 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:50.045141 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:50.052352 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.053865 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.053865 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.054084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.183503 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.191433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.192955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.194120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ee2ffe5f-c404-40ff-832e-41183ae92274 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.153550 May 25 15:04:50.194693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 487/1030] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:50 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:50.635995 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:50.635995 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:50.638342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.638834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.639615 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.640055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.679770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-a766d6bc-6aad-4b14-8e1d-e50fae0a28fe req-49fa2b48-01e1-4c4a-b686-c6219bd20bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "name": "network-vif-plugged", "status": "completed", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:50.697092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-a766d6bc-6aad-4b14-8e1d-e50fae0a28fe req-49fa2b48-01e1-4c4a-b686-c6219bd20bab service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:50.697092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-a766d6bc-6aad-4b14-8e1d-e50fae0a28fe req-49fa2b48-01e1-4c4a-b686-c6219bd20bab service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:50.701559 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-a766d6bc-6aad-4b14-8e1d-e50fae0a28fe req-49fa2b48-01e1-4c4a-b686-c6219bd20bab service nova] Creating event network-vif-plugged:d0275964-ead5-40f3-93a4-63cb2514a0ae for instance 7adffb0a-813f-410e-88eb-e901f068c873 on hv-cinder-83028 May 25 15:04:50.707932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-a766d6bc-6aad-4b14-8e1d-e50fae0a28fe req-49fa2b48-01e1-4c4a-b686-c6219bd20bab service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 May 25 15:04:50.708558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 488/1031] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:04:50.773683 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:50.781138 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-23babdc4-dc77-42f3-8670-052a4be7609f tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.155590 May 25 15:04:50.781709 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 544/1032] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:50 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:51.357915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:51.358623 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:51.365478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.365938 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:51.366735 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.367178 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:51.499457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:51.507278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:51.508815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:51.510017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-66e37d44-e639-48f1-bb30-7d991b649488 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.301566 May 25 15:04:51.510566 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 489/1033] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:51 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:51.798008 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:51.798553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:51.805009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.805464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:51.806230 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:51.806691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:51.935591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:51.943159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4808d7ba-8c53-45b5-b6fd-efc75fee6176 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.149149 May 25 15:04:51.943735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 545/1034] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:51 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:52.528857 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:52.529466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:52.535984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.536428 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.537198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.537642 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.671949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:52.680381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:52.682333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:52.683958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7149122a-555f-49d7-8823-27284a84acaf tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.159125 May 25 15:04:52.684519 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 490/1035] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:52 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:52.725591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-3cff4feb-8fe3-4e05-b151-71c924204ad7 req-e6b3e9df-96cb-4f44-9ede-e15622c75e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "631dc815-ce7a-40b3-9bdb-35f04b2fca01", "name": "network-vif-plugged", "status": "completed", "tag": "f7072705-f1db-4bc8-a3d5-6e626bab50e6"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:52.733459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-3cff4feb-8fe3-4e05-b151-71c924204ad7 req-e6b3e9df-96cb-4f44-9ede-e15622c75e9c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.734032 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-3cff4feb-8fe3-4e05-b151-71c924204ad7 req-e6b3e9df-96cb-4f44-9ede-e15622c75e9c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.744949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-3cff4feb-8fe3-4e05-b151-71c924204ad7 req-e6b3e9df-96cb-4f44-9ede-e15622c75e9c service nova] Creating event network-vif-plugged:f7072705-f1db-4bc8-a3d5-6e626bab50e6 for instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 on hv-cinder-83028 May 25 15:04:52.750798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-3cff4feb-8fe3-4e05-b151-71c924204ad7 req-e6b3e9df-96cb-4f44-9ede-e15622c75e9c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029276 May 25 15:04:52.751460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 546/1036] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:04:52.960428 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:52.961044 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:52.967191 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.967650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:52.968413 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:52.968849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:53.099197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.107082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-72a99da8-8e47-4f87-8bf3-de15fdd0ca47 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.150498 May 25 15:04:53.107655 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 491/1037] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:52 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:53.703139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:53.703758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:53.710567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:53.712358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:53.712358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:53.712358 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:53.862250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.862250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.862517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:53.862517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-57930c6e-1792-4660-82e4-6d4b43ba72a6 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.158786 May 25 15:04:53.862517 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 547/1038] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:53 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 15:04:54.124026 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:54.124634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:54.131480 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:54.131930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:54.132700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:54.133181 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:54.505088 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:54.512591 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4c25aa96-c034-4043-ab9d-42ea4c0a80cb tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1367 microversion: 2.1 time: 0.392636 May 25 15:04:54.513164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 492/1039] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:54 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:54.876247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:54.876924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:54.883381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:54.883826 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:54.884588 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:54.885020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:55.009853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.017807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.019929 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.021101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-56158ba5-13e3-458a-a9d6-869aa14010e9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1730 microversion: 2.20 time: 0.149402 May 25 15:04:55.021757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 548/1040] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:54 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:55.530029 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:55.530662 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:55.537799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:55.539333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:55.539333 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:55.539585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:55.667516 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:55.674961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5fc38286-d266-4ec1-bef4-02109d487df9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1557 microversion: 2.1 time: 0.148768 May 25 15:04:55.675548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 493/1041] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:04:55 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:04:55.691482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:55.691999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:55.698060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:55.698593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:55.699497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:55.700005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:55.780344 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8c744465-7edc-41c3-87b0-6e9e8bf5e999 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092735 May 25 15:04:55.780890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 549/1042] 10.222.0.74 () {58 vars in 1274 bytes} [Wed May 25 15:04:55 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:56.040010 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:56.040565 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:56.046945 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:56.047402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:56.048213 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:56.048653 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:56.283502 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:56.291635 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:56.293063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:04:56.294228 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e3f28923-8a77-49c1-9eac-65839811a23c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1717 microversion: 2.20 time: 0.258412 May 25 15:04:56.294823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 494/1043] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:04:56 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1717 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:04:56.904935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-071fc9c0-f7a4-4bab-85ac-9ffdc30b5f6f req-504b76e2-0070-4e58-8e2e-35c1a83b9d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "631dc815-ce7a-40b3-9bdb-35f04b2fca01", "tag": "f7072705-f1db-4bc8-a3d5-6e626bab50e6"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:04:56.915070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-071fc9c0-f7a4-4bab-85ac-9ffdc30b5f6f req-504b76e2-0070-4e58-8e2e-35c1a83b9d45 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:56.915539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-071fc9c0-f7a4-4bab-85ac-9ffdc30b5f6f req-504b76e2-0070-4e58-8e2e-35c1a83b9d45 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:56.928196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-071fc9c0-f7a4-4bab-85ac-9ffdc30b5f6f req-504b76e2-0070-4e58-8e2e-35c1a83b9d45 service nova] Creating event network-changed:f7072705-f1db-4bc8-a3d5-6e626bab50e6 for instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 on hv-cinder-83028 May 25 15:04:56.933858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-071fc9c0-f7a4-4bab-85ac-9ffdc30b5f6f req-504b76e2-0070-4e58-8e2e-35c1a83b9d45 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 May 25 15:04:56.934713 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 550/1044] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:57.561146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:57.562231 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:57.569380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:57.569837 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:57.570622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:57.571101 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:57.601487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4fa4d2a7-4964-47f5-9ee5-b1b15d1b8af5 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 May 25 15:04:57.602070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 495/1045] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:04:57 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:04:57.612808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:04:57.613492 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:04:57.620710 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:57.621352 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:57.622163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:04:57.622604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:04:57.653980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8eeb5f32-db0b-47df-b611-bb942db7e562 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/1c3ce182-6bce-42c0-bd8f-946878ed79fd" status: 200 len: 194 microversion: 2.1 time: 0.045665 May 25 15:04:57.654583 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 551/1046] 10.222.0.74 () {58 vars in 1412 bytes} [Wed May 25 15:04:57 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/1c3ce182-6bce-42c0-bd8f-946878ed79fd => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:00.442158 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32124237-91a9-4f75-8388-267204014ea2"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:00.443245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:00.449741 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:00.450183 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:00.450970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:00.451406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:01.428923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b0a318c4-cab6-4e24-b7dd-08157e20d5fa tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "POST /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991575 May 25 15:05:01.429544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 496/1047] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:05:00 2022] POST /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:09.990140 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:09.991185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:09.993813 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=23 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:09.994507 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=45 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:09.999225 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:09.999657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.000500 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.000934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.031493 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-40e2af55-cd8d-49ec-bd4f-66832ab09411 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045468 May 25 15:05:10.032056 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 552/1048] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:05:09 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:10.173985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:10.174559 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:10.181381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.181845 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.182678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.183121 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.215843 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ba685752-bc75-4e75-91c9-bb6a482f8028 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/1c3ce182-6bce-42c0-bd8f-946878ed79fd" status: 200 len: 194 microversion: 2.1 time: 0.046288 May 25 15:05:10.216419 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 497/1049] 10.222.0.74 () {58 vars in 1412 bytes} [Wed May 25 15:05:10 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/1c3ce182-6bce-42c0-bd8f-946878ed79fd => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:10.226080 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:10.226784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:10.233071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.233606 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.234461 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:10.235208 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:10.319813 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lazy-loading 'services' on Instance uuid 85103939-9db9-4bb5-943d-2236c81b7820 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:05:10.666690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-af08abdf-1e72-4f40-95ae-5201fe67be07 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/1c3ce182-6bce-42c0-bd8f-946878ed79fd" status: 202 len: 0 microversion: 2.1 time: 0.444298 May 25 15:05:10.667301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 553/1050] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:05:10 2022] DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/1c3ce182-6bce-42c0-bd8f-946878ed79fd => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:05:12.831398 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:12.832020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:12.839376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.839853 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.840655 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.841098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.870020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-eb0e3e8d-af4d-403f-894f-3b5def415681 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/32124237-91a9-4f75-8388-267204014ea2" status: 200 len: 194 microversion: 2.1 time: 0.042763 May 25 15:05:12.870595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 498/1051] 10.222.0.74 () {58 vars in 1412 bytes} [Wed May 25 15:05:12 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/32124237-91a9-4f75-8388-267204014ea2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:12.881591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:12.882219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:12.888719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.899999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.899999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:12.899999 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:12.971837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lazy-loading 'services' on Instance uuid 85103939-9db9-4bb5-943d-2236c81b7820 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:05:13.294976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dd5d9ebb-898a-4147-892b-6dc69a27ea92 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/32124237-91a9-4f75-8388-267204014ea2" status: 202 len: 0 microversion: 2.1 time: 0.417873 May 25 15:05:13.295502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 554/1052] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:05:12 2022] DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments/32124237-91a9-4f75-8388-267204014ea2 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:05:15.507710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:15.508661 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:15.515159 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.515581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.516337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.516767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.532959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:15.545283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-eb3a3f31-54f5-4ed8-bfb9-a4321545ce2b tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041529 May 25 15:05:15.552405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 499/1053] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:05:15 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:05:15.655132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:15.656207 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:15.663900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.664356 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.665790 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.666235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.694771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-aaf0a29c-b154-46ba-9a1c-df2ba1847eba tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044350 May 25 15:05:15.695321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 555/1054] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:05:15 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:05:15.752301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:15.752978 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:15.755209 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=31 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:15.760256 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.760714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.761593 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:15.762041 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:15.788018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Going to try to terminate instance {{(pid=129907) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:05:16.184835 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d249ef45-af56-4745-9efb-ad465a2abcc3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 204 len: 0 microversion: 2.1 time: 0.436059 May 25 15:05:16.185428 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 500/1055] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:05:15 2022] DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:05:16.193629 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:16.195953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:16.200794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:16.201247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:16.202016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:16.202455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:16.333776 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:16.341954 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-68dd6f89-0fad-4a13-9a63-5d94c2d0aeb2 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1674 microversion: 2.1 time: 0.152163 May 25 15:05:16.342523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 556/1056] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:16 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:17.359761 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:17.360416 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:17.366884 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:17.367358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:17.368207 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:17.368702 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:17.502785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:17.510761 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a2f57220-76a9-43c3-944d-ae36e161f69a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1674 microversion: 2.1 time: 0.155308 May 25 15:05:17.511334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 501/1057] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:17 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:18.527778 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:18.528396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:18.534961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:18.535415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:18.536188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:18.536628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:18.675699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:18.684354 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3617ac44-0d8d-43d7-a071-81edfdd7c6f3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1674 microversion: 2.1 time: 0.160462 May 25 15:05:18.684912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 557/1058] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:18 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:19.710499 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:19.711330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:19.714167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-2e59e63b-d4c3-43fe-adde-da4be6756ac5 req-e8ac1740-8d2c-4c3f-b7b0-1fb602252ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85103939-9db9-4bb5-943d-2236c81b7820", "name": "network-vif-deleted", "tag": "b4734f99-b653-4271-85f9-99aee86cd902"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:19.719711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.720220 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.721078 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.721630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.723811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-2e59e63b-d4c3-43fe-adde-da4be6756ac5 req-e8ac1740-8d2c-4c3f-b7b0-1fb602252ce0 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:19.724347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-2e59e63b-d4c3-43fe-adde-da4be6756ac5 req-e8ac1740-8d2c-4c3f-b7b0-1fb602252ce0 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:19.735662 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-2e59e63b-d4c3-43fe-adde-da4be6756ac5 req-e8ac1740-8d2c-4c3f-b7b0-1fb602252ce0 service nova] Creating event network-vif-deleted:b4734f99-b653-4271-85f9-99aee86cd902 for instance 85103939-9db9-4bb5-943d-2236c81b7820 on hv-cinder-83028 May 25 15:05:19.741015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-2e59e63b-d4c3-43fe-adde-da4be6756ac5 req-e8ac1740-8d2c-4c3f-b7b0-1fb602252ce0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030559 May 25 15:05:19.741599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 558/1059] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:19.789042 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:19.797874 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-798da0b0-af75-4c6e-a2c4-958abab99868 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1606 microversion: 2.1 time: 0.099694 May 25 15:05:19.798698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 502/1060] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:19 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:05:20.816860 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:20.817681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:20.825106 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:20.831018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:20.831018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:20.831018 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:20.864699 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:20.865150 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:20.865601 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lazy-loading 'fault' on Instance uuid 85103939-9db9-4bb5-943d-2236c81b7820 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:05:20.910376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dba831ebb584de5a0c84f39901d3c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a36e186c5f4d3c8b9030d91f6a30f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:20.918005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-85504164-b9e7-450a-9759-704b5af11d3d tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 200 len: 1327 microversion: 2.1 time: 0.106010 May 25 15:05:20.918562 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 559/1061] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:20 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:21.936272 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:21.936876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:21.943405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:21.943852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:21.944606 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:21.945043 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:21.957944 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] HTTP exception thrown: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Request method failure captured: May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 HTTP/1.1 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM8latX2PnMvTXqg1ny6zXP1ILvRuQOFW9LSq-mVPhkT4QzGGM2ob5Cd8EcJAKlwkc4YOU2q7J-h_9ULjFYF_TKjxN-0_ERhEiWPd63LGmdOyl1sdRbrzCybzY5EIfTZuJagmNN3Yed_qP9cJiF5Hxb2bdWK2jX4RujuzoJVBtMv04 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:05:21.959600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}] May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 9dba831ebb584de5a0c84f39901d3c32 May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:21.961245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '85103939-9db9-4bb5-943d-2236c81b7820'} May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:21.962240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:21.964016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:21.965484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Returning 404 to user: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:21.965484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a2363f58-1821-422c-b7bd-e130fca4d07f tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 404 len: 111 microversion: 2.1 time: 0.029575 May 25 15:05:21.965484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 503/1062] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:21 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:21.969772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-021c9996-8392-4f62-aab3-3a35865f095a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '.version_select at 0x7f6fb451c9d0>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:22.073855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-021c9996-8392-4f62-aab3-3a35865f095a tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930081246" status: 202 len: 0 microversion: 2.1 time: 0.107775 May 25 15:05:22.074426 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 560/1063] 10.222.0.74 () {58 vars in 1220 bytes} [Wed May 25 15:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930081246 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:05:25.821279 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:25.821779 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:25.828354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.828805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.829576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.830019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.843586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] HTTP exception thrown: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Request method failure captured: May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 HTTP/1.1 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM8latX2PnMvTXqg1ny6zXP1ILvRuQOFW9LSq-mVPhkT4QzGGM2ob5Cd8EcJAKlwkc4YOU2q7J-h_9ULjFYF_TKjxN-0_ERhEiWPd63LGmdOyl1sdRbrzCybzY5EIfTZuJagmNN3Yed_qP9cJiF5Hxb2bdWK2jX4RujuzoJVBtMv04 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:05:25.845106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}] May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 9dba831ebb584de5a0c84f39901d3c32 May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.846529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '85103939-9db9-4bb5-943d-2236c81b7820'} May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:25.847319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.848698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:25.850322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Returning 404 to user: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:25.850322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-873f49b2-564d-4aa8-9ea1-c332d9e5e604 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 404 len: 111 microversion: 2.1 time: 0.029077 May 25 15:05:25.850322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 504/1064] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:05:25 2022] DELETE /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:25.856908 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:25.857532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 85103939-9db9-4bb5-943d-2236c81b7820] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:25.864321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.864767 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.865538 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:25.865969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:25.880151 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] HTTP exception thrown: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Request method failure captured: May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 HTTP/1.1 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM8latX2PnMvTXqg1ny6zXP1ILvRuQOFW9LSq-mVPhkT4QzGGM2ob5Cd8EcJAKlwkc4YOU2q7J-h_9ULjFYF_TKjxN-0_ERhEiWPd63LGmdOyl1sdRbrzCybzY5EIfTZuJagmNN3Yed_qP9cJiF5Hxb2bdWK2jX4RujuzoJVBtMv04 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:05:25.881869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}] May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 9dba831ebb584de5a0c84f39901d3c32 May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.883455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '85103939-9db9-4bb5-943d-2236c81b7820'} May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:25.884553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. May 25 15:05:25.886058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:25.887460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Returning 404 to user: Instance 85103939-9db9-4bb5-943d-2236c81b7820 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:25.887460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d9a7a7f3-3f61-41e4-924d-31e99eff4659 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820" status: 404 len: 111 microversion: 2.1 time: 0.032233 May 25 15:05:25.887460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 561/1065] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:25 2022] GET /compute/v2.1/servers/85103939-9db9-4bb5-943d-2236c81b7820 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:27.202395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:27.202948 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:27.209795 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.210236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.211032 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.211546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.224850 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] HTTP exception thrown: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Request method failure captured: May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed HTTP/1.1 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM8latX2PnMvTXqg1ny6zXP1ILvRuQOFW9LSq-mVPhkT4QzGGM2ob5Cd8EcJAKlwkc4YOU2q7J-h_9ULjFYF_TKjxN-0_ERhEiWPd63LGmdOyl1sdRbrzCybzY5EIfTZuJagmNN3Yed_qP9cJiF5Hxb2bdWK2jX4RujuzoJVBtMv04 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:05:27.226390 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}] May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 9dba831ebb584de5a0c84f39901d3c32 May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.227955 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed'} May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:27.229380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.230873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:27.232329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Returning 404 to user: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:27.232329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1386d24c-0b12-4ed9-99ee-033bc0bf4418 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 404 len: 111 microversion: 2.1 time: 0.029264 May 25 15:05:27.232329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 505/1066] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:05:27 2022] DELETE /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:27.236875 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:27.237528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] [instance: 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:27.245028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.245482 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.246259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:27.246729 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:27.259808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] HTTP exception thrown: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Request method failure captured: May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed HTTP/1.1 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM8latX2PnMvTXqg1ny6zXP1ILvRuQOFW9LSq-mVPhkT4QzGGM2ob5Cd8EcJAKlwkc4YOU2q7J-h_9ULjFYF_TKjxN-0_ERhEiWPd63LGmdOyl1sdRbrzCybzY5EIfTZuJagmNN3Yed_qP9cJiF5Hxb2bdWK2jX4RujuzoJVBtMv04 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:05:27.261330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/89a36e186c5f4d3c8b9030d91f6a30f6"}]}] May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 89a36e186c5f4d3c8b9030d91f6a30f6 May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-394737464 May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 9dba831ebb584de5a0c84f39901d3c32 May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeTestJSON-394737464-project May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.262900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed'} May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:27.263759 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. May 25 15:05:27.265171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:27.266515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] Returning 404 to user: Instance 36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:27.266515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ef8f6c6d-dc6d-4da5-8918-837b8d2579b3 tempest-AttachVolumeTestJSON-394737464 tempest-AttachVolumeTestJSON-394737464-project] 10.222.0.74 "GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed" status: 404 len: 111 microversion: 2.1 time: 0.029717 May 25 15:05:27.266515 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 562/1067] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:05:27 2022] GET /compute/v2.1/servers/36f3dfc3-c29d-40db-a7b7-53e87d9fe2ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:33.287147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-959ff51d-ce08-49e5-a8b4-6c0e36546b0b tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Action: 'create', calling method: .version_select at 0x7f6fb472d940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-534510269", "metadata": {"Type": "work"}}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-959ff51d-ce08-49e5-a8b4-6c0e36546b0b tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Request method failure captured: May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 121 May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkW96TIgRy2YMOlzBnuaMcDfTpf3bE1piW10rV4iBG2ADJIZIVwDuyWR_K6p209npkGPPrOElDGmuvPRXAGOFbaktsDBK_WytnW0zd9KKNGo1LsppGou7C1WEAbJ0tNhXQAltxR_BlfvIoI5jBOZJLghQR7WnhwL8zlQou9AGF5QPVQ May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:05:33.304125 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}] May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 0ac86e4832d340f298773b5c4cf7feb0 May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-534510269", "metadata": {"Type": "work"}}} May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: May 25 15:05:33.305728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-534510269', 'metadata': {'Type': 'work'}}}} May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise error May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi '#$%' May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:33.306918 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 15:05:33.308622 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 15:05:33.310684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 15:05:33.310684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.310684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-959ff51d-ce08-49e5-a8b4-6c0e36546b0b tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:33.310684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-959ff51d-ce08-49e5-a8b4-6c0e36546b0b tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131472 May 25 15:05:33.310684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 506/1068] 10.222.0.74 () {60 vars in 1155 bytes} [Wed May 25 15:05:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:05:33.316803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5b18c6d7-4b97-4901-84d4-e379afa920aa tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Action: 'create', calling method: .version_select at 0x7f6fb46caaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1791238396", "metadata": {"Type": "work"}}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5b18c6d7-4b97-4901-84d4-e379afa920aa tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Request method failure captured: May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 120 May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkW96TIgRy2YMOlzBnuaMcDfTpf3bE1piW10rV4iBG2ADJIZIVwDuyWR_K6p209npkGPPrOElDGmuvPRXAGOFbaktsDBK_WytnW0zd9KKNGo1LsppGou7C1WEAbJ0tNhXQAltxR_BlfvIoI5jBOZJLghQR7WnhwL8zlQou9AGF5QPVQ May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:05:33.320338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}] May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 0ac86e4832d340f298773b5c4cf7feb0 May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1791238396", "metadata": {"Type": "work"}}} May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 15:05:33.321918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1791238396', 'metadata': {'Type': 'work'}}}} May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise error May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi '0' May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:33.322967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 15:05:33.324602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 15:05:33.325951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 15:05:33.325951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.325951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5b18c6d7-4b97-4901-84d4-e379afa920aa tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:33.325951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5b18c6d7-4b97-4901-84d4-e379afa920aa tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008863 May 25 15:05:33.325951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 563/1069] 10.222.0.74 () {60 vars in 1155 bytes} [Wed May 25 15:05:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:05:33.334856 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-709c8745-ee09-4427-93a2-576351aa5512 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Action: 'create', calling method: .version_select at 0x7f6fb487bdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-35151477", "metadata": {"Type": "work"}}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-709c8745-ee09-4427-93a2-576351aa5512 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Request method failure captured: May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 117 May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkW96TIgRy2YMOlzBnuaMcDfTpf3bE1piW10rV4iBG2ADJIZIVwDuyWR_K6p209npkGPPrOElDGmuvPRXAGOFbaktsDBK_WytnW0zd9KKNGo1LsppGou7C1WEAbJ0tNhXQAltxR_BlfvIoI5jBOZJLghQR7WnhwL8zlQou9AGF5QPVQ May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:05:33.335491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}] May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 0ac86e4832d340f298773b5c4cf7feb0 May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-35151477", "metadata": {"Type": "work"}}} May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: May 25 15:05:33.336989 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-35151477', 'metadata': {'Type': 'work'}}}} May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise error May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi '' May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:33.338066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 15:05:33.340184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 15:05:33.341650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 15:05:33.341650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.341650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-709c8745-ee09-4427-93a2-576351aa5512 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:33.341650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-709c8745-ee09-4427-93a2-576351aa5512 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009130 May 25 15:05:33.341650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 507/1070] 10.222.0.74 () {60 vars in 1155 bytes} [Wed May 25 15:05:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 15:05:33.347204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e1823bb9-7c40-46d8-93cb-07fda6b62869 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Calling method '.version_select at 0x7f6fb450a160>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:33.376005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-e1823bb9-7c40-46d8-93cb-07fda6b62869 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] HTTP exception thrown: Volume tempest-invalid-1292925950 could not be found. May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e1823bb9-7c40-46d8-93cb-07fda6b62869 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Request method failure captured: May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1292925950 HTTP/1.1 May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkW96TIgRy2YMOlzBnuaMcDfTpf3bE1piW10rV4iBG2ADJIZIVwDuyWR_K6p209npkGPPrOElDGmuvPRXAGOFbaktsDBK_WytnW0zd9KKNGo1LsppGou7C1WEAbJ0tNhXQAltxR_BlfvIoI5jBOZJLghQR7WnhwL8zlQou9AGF5QPVQ May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:05:33.378042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}] May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 0ac86e4832d340f298773b5c4cf7feb0 May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Volume tempest-invalid-1292925950 could not be found. May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'tempest-invalid-1292925950'} May 25 15:05:33.379635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1292925950 could not be found. (HTTP 404) (Request-ID: req-cb294436-249e-47e9-a460-57e5f70b44e8) May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.380635 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 15:05:33.382073 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1292925950 could not be found. May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:33.383379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1292925950 could not be found. May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1292925950 could not be found. May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e1823bb9-7c40-46d8-93cb-07fda6b62869 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Returning 404 to user: Volume tempest-invalid-1292925950 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e1823bb9-7c40-46d8-93cb-07fda6b62869 tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1292925950" status: 404 len: 99 microversion: 2.1 time: 0.036733 May 25 15:05:33.384808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 564/1071] 10.222.0.74 () {58 vars in 1217 bytes} [Wed May 25 15:05:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1292925950 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 25 15:05:33.389112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a6dd4a33-339c-4f6c-b8d6-b1b186f1c93e tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003756 May 25 15:05:33.389604 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 508/1072] 10.222.0.74 () {58 vars in 1139 bytes} [Wed May 25 15:05:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 25 15:05:33.397637 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-49de9668-644e-4d70-b582-95712c6749ae tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003603 May 25 15:05:33.398125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 565/1073] 10.222.0.74 () {58 vars in 1136 bytes} [Wed May 25 15:05:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 15:05:33.406329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-41441d27-1d6d-457c-9a71-71a1265a99db tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Calling method '.version_select at 0x7f6fb48a61f0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:33.434581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-41441d27-1d6d-457c-9a71-71a1265a99db tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] HTTP exception thrown: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-41441d27-1d6d-457c-9a71-71a1265a99db tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Request method failure captured: May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: DELETE /compute/v2.1/os-volumes/51b8fa5d-d335-4657-bb5c-fe07bfea07e4 HTTP/1.1 May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkW96TIgRy2YMOlzBnuaMcDfTpf3bE1piW10rV4iBG2ADJIZIVwDuyWR_K6p209npkGPPrOElDGmuvPRXAGOFbaktsDBK_WytnW0zd9KKNGo1LsppGou7C1WEAbJ0tNhXQAltxR_BlfvIoI5jBOZJLghQR7WnhwL8zlQou9AGF5QPVQ May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:05:33.437873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}] May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 0ac86e4832d340f298773b5c4cf7feb0 May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '51b8fa5d-d335-4657-bb5c-fe07bfea07e4'} May 25 15:05:33.439471 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. (HTTP 404) (Request-ID: req-63e38dba-f8ab-4f16-bc83-a382a6dc8f40) May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.440393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 15:05:33.441640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 15:05:33.442969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-41441d27-1d6d-457c-9a71-71a1265a99db tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Returning 404 to user: Volume 51b8fa5d-d335-4657-bb5c-fe07bfea07e4 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-41441d27-1d6d-457c-9a71-71a1265a99db tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/51b8fa5d-d335-4657-bb5c-fe07bfea07e4" status: 404 len: 109 microversion: 2.1 time: 0.036582 May 25 15:05:33.444161 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 509/1074] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 15:05:33 2022] DELETE /compute/v2.1/os-volumes/51b8fa5d-d335-4657-bb5c-fe07bfea07e4 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:33.449884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e3a31b97-d9ea-4a8a-abdd-b19e53648f9f tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Calling method '.version_select at 0x7f6fb4548940>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:33.476655 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-e3a31b97-d9ea-4a8a-abdd-b19e53648f9f tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] HTTP exception thrown: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e3a31b97-d9ea-4a8a-abdd-b19e53648f9f tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Request method failure captured: May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/os-volumes/03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf HTTP/1.1 May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkW96TIgRy2YMOlzBnuaMcDfTpf3bE1piW10rV4iBG2ADJIZIVwDuyWR_K6p209npkGPPrOElDGmuvPRXAGOFbaktsDBK_WytnW0zd9KKNGo1LsppGou7C1WEAbJ0tNhXQAltxR_BlfvIoI5jBOZJLghQR7WnhwL8zlQou9AGF5QPVQ May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:05:33.478574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/22b9e0d82c014a40b4828b19bff22186"}]}] May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 22b9e0d82c014a40b4828b19bff22186 May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesNegativeTest-141549260 May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 0ac86e4832d340f298773b5c4cf7feb0 May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesNegativeTest-141549260-project May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf'} May 25 15:05:33.480834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. (HTTP 404) (Request-ID: req-dacc5f03-b5e1-498c-b4a4-57d47e0df786) May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.481818 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 15:05:33.483184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 15:05:33.485445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e3a31b97-d9ea-4a8a-abdd-b19e53648f9f tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] Returning 404 to user: Volume 03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e3a31b97-d9ea-4a8a-abdd-b19e53648f9f tempest-VolumesNegativeTest-141549260 tempest-VolumesNegativeTest-141549260-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf" status: 404 len: 109 microversion: 2.1 time: 0.034571 May 25 15:05:33.486864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 566/1075] 10.222.0.74 () {58 vars in 1244 bytes} [Wed May 25 15:05:33 2022] GET /compute/v2.1/os-volumes/03fe6bce-2226-46cf-a4fe-4d2c4a30fdbf => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:05:52.615855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.617278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.622086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:52.623017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:52.629185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.629635 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.630481 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.630942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.661693 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-daa01873-80ba-4620-9f9d-eb7e349aa8f9 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047176 May 25 15:05:52.662517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 510/1076] 10.222.0.74 () {60 vars in 1342 bytes} [Wed May 25 15:05:52 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:05:52.719122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.720217 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.724335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:52.724844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:52.731084 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.735850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.735850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:52.735850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:52.757797 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:05:53.150509 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-38e8f012-cc32-447f-9a66-d6e9ad5e937c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 204 len: 0 microversion: 2.20 time: 0.432863 May 25 15:05:53.151168 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 567/1077] 10.222.0.74 () {60 vars in 1279 bytes} [Wed May 25 15:05:52 2022] DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 15:05:53.159960 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:53.160596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:53.167420 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:53.167865 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:53.168920 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:53.169048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:53.301201 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:53.309646 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:53.312322 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:53.313927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4d110b6d-7604-4852-ae77-739f8e58d661 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.158553 May 25 15:05:53.315355 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 511/1078] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:05:53 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:54.333871 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:54.335160 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:54.343900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:54.343900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:54.343900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:54.343900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:54.480747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:54.490271 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:54.491853 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:54.493028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-fae45755-a980-4a4e-823e-d0ca89486de3 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1723 microversion: 2.20 time: 0.164696 May 25 15:05:54.493602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 568/1079] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:05:54 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:55.513426 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:55.514048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:55.521884 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:55.533385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:55.533385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:55.533385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:55.596484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:55.601565 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:55.603266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:55.604570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b92de59f-3035-4720-ae66-8e7f344f2f7a tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1655 microversion: 2.20 time: 0.095105 May 25 15:05:55.605185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 512/1080] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:05:55 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:56.061784 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-4b30c48d-5a2a-44d6-a4cb-3f86d39e8cb2 req-07e731c7-030b-47fb-9a44-fad057a59db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adffb0a-813f-410e-88eb-e901f068c873", "name": "network-vif-deleted", "tag": "d0275964-ead5-40f3-93a4-63cb2514a0ae"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:05:56.070806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-4b30c48d-5a2a-44d6-a4cb-3f86d39e8cb2 req-07e731c7-030b-47fb-9a44-fad057a59db8 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:56.071256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-4b30c48d-5a2a-44d6-a4cb-3f86d39e8cb2 req-07e731c7-030b-47fb-9a44-fad057a59db8 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:56.083126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-4b30c48d-5a2a-44d6-a4cb-3f86d39e8cb2 req-07e731c7-030b-47fb-9a44-fad057a59db8 service nova] Creating event network-vif-deleted:d0275964-ead5-40f3-93a4-63cb2514a0ae for instance 7adffb0a-813f-410e-88eb-e901f068c873 on hv-cinder-83028 May 25 15:05:56.088243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-4b30c48d-5a2a-44d6-a4cb-3f86d39e8cb2 req-07e731c7-030b-47fb-9a44-fad057a59db8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153938 May 25 15:05:56.088850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 569/1081] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:05:56.624253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:56.624792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:56.631798 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:56.632248 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:56.633025 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:56.633461 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:56.665959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:56.666505 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:56.667000 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lazy-loading 'fault' on Instance uuid 7adffb0a-813f-410e-88eb-e901f068c873 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:05:56.713723 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:56.720519 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:56.722870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '237510469a8e4e36ad40a34cdf705656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c8213736cf4113951fbb3520c18183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:05:56.724172 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-246b918c-1aad-4fb8-9c3f-af4779b18ffb tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 200 len: 1370 microversion: 2.20 time: 0.104274 May 25 15:05:56.724931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 513/1082] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:05:56 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 15:05:57.744055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:57.744775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:05:57.751725 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:57.752746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:57.753521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:05:57.754003 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:05:57.767546 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] HTTP exception thrown: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Request method failure captured: May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 HTTP/1.1 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM5abMfRNmSpfxMk1gIjH8D2wwrCIIaEAcmIEHk9Drj6rJc8SDZrS2IIUD-SYSWPdGq-c7ArYzaHMKuYywQIlZ1a6zWpahYrySSwcKfzpl-ULgFCZeTjcP7z7uTvuM-bW989Xzuh4c5gC3i46u70QtvoyKr9Kl8ngRhfQQ0GFMIF70 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:05:57.769375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_18c8213736cf4113951fbb3520c18183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/18c8213736cf4113951fbb3520c18183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}] May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 237510469a8e4e36ad40a34cdf705656 May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:05:57.771088 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '7adffb0a-813f-410e-88eb-e901f068c873'} May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:05:57.771949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:05:57.773364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:05:57.774700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Returning 404 to user: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:05:57.774700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8eba2ef0-0f37-4c21-af64-da64f57d0c6d tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 404 len: 111 microversion: 2.20 time: 0.031276 May 25 15:05:57.774700 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 570/1083] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:05:57 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:05:57.780538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-2d6a021c-d790-431a-8ca7-3db8c180cf2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '.version_select at 0x7f6fb48fa1f0>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:05:57.894773 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-2d6a021c-d790-431a-8ca7-3db8c180cf2f tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336321822" status: 204 len: 0 microversion: 2.20 time: 0.118121 May 25 15:05:57.895277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 514/1084] 10.222.0.74 () {60 vars in 1258 bytes} [Wed May 25 15:05:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336321822 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 15:06:00.171980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:00.172519 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:00.179731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:00.180177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:00.180942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:00.181377 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:00.195819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] HTTP exception thrown: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Request method failure captured: May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 HTTP/1.1 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM5abMfRNmSpfxMk1gIjH8D2wwrCIIaEAcmIEHk9Drj6rJc8SDZrS2IIUD-SYSWPdGq-c7ArYzaHMKuYywQIlZ1a6zWpahYrySSwcKfzpl-ULgFCZeTjcP7z7uTvuM-bW989Xzuh4c5gC3i46u70QtvoyKr9Kl8ngRhfQQ0GFMIF70 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:00.197701 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_18c8213736cf4113951fbb3520c18183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/18c8213736cf4113951fbb3520c18183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}] May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 237510469a8e4e36ad40a34cdf705656 May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.199256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '7adffb0a-813f-410e-88eb-e901f068c873'} May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:00.200007 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.201244 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:00.202504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Returning 404 to user: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:00.202504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c6e2a41e-5431-4471-9abc-8b7d8fc0ae4c tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 404 len: 111 microversion: 2.20 time: 0.031270 May 25 15:06:00.202504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 571/1085] 10.222.0.74 () {60 vars in 1279 bytes} [Wed May 25 15:06:00 2022] DELETE /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:06:00.209299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:00.209904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 7adffb0a-813f-410e-88eb-e901f068c873] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:00.216758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:00.217204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:00.217963 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:00.218395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:00.232109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] HTTP exception thrown: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Request method failure captured: May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 HTTP/1.1 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM5abMfRNmSpfxMk1gIjH8D2wwrCIIaEAcmIEHk9Drj6rJc8SDZrS2IIUD-SYSWPdGq-c7ArYzaHMKuYywQIlZ1a6zWpahYrySSwcKfzpl-ULgFCZeTjcP7z7uTvuM-bW989Xzuh4c5gC3i46u70QtvoyKr9Kl8ngRhfQQ0GFMIF70 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:06:00.233663 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_18c8213736cf4113951fbb3520c18183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/18c8213736cf4113951fbb3520c18183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}] May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 237510469a8e4e36ad40a34cdf705656 May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.241902 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '7adffb0a-813f-410e-88eb-e901f068c873'} May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:00.242811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. May 25 15:06:00.244308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:00.246071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Returning 404 to user: Instance 7adffb0a-813f-410e-88eb-e901f068c873 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:00.246071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-085cae9f-e32c-4877-8a49-3c5335732787 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873" status: 404 len: 111 microversion: 2.20 time: 0.030848 May 25 15:06:00.246071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 515/1086] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:06:00 2022] GET /compute/v2.1/servers/7adffb0a-813f-410e-88eb-e901f068c873 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:06:01.623908 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:01.624411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:01.631884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:01.645578 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:01.645578 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:01.645578 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:01.649631 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] HTTP exception thrown: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Request method failure captured: May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 HTTP/1.1 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM5abMfRNmSpfxMk1gIjH8D2wwrCIIaEAcmIEHk9Drj6rJc8SDZrS2IIUD-SYSWPdGq-c7ArYzaHMKuYywQIlZ1a6zWpahYrySSwcKfzpl-ULgFCZeTjcP7z7uTvuM-bW989Xzuh4c5gC3i46u70QtvoyKr9Kl8ngRhfQQ0GFMIF70 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:01.651221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_18c8213736cf4113951fbb3520c18183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/18c8213736cf4113951fbb3520c18183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}] May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: 237510469a8e4e36ad40a34cdf705656 May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.652831 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '1f09fd70-df36-4976-a829-ebe720c7e516'} May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:01.653802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.655281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:01.656690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Returning 404 to user: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:01.656690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d7306898-9252-4957-8f7f-69412c8427af tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 404 len: 111 microversion: 2.20 time: 0.032640 May 25 15:06:01.656690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 572/1087] 10.222.0.74 () {60 vars in 1279 bytes} [Wed May 25 15:06:01 2022] DELETE /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:06:01.661339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:01.661959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] [instance: 1f09fd70-df36-4976-a829-ebe720c7e516] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:01.668986 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:01.699236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:01.699236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:01.699236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:01.699236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] HTTP exception thrown: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Request method failure captured: May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 HTTP/1.1 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM5abMfRNmSpfxMk1gIjH8D2wwrCIIaEAcmIEHk9Drj6rJc8SDZrS2IIUD-SYSWPdGq-c7ArYzaHMKuYywQIlZ1a6zWpahYrySSwcKfzpl-ULgFCZeTjcP7z7uTvuM-bW989Xzuh4c5gC3i46u70QtvoyKr9Kl8ngRhfQQ0GFMIF70 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Openstack-Nova-Api-Version: 2.20 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:06:01.699657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_18c8213736cf4113951fbb3520c18183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/18c8213736cf4113951fbb3520c18183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/18c8213736cf4113951fbb3520c18183"}]}] May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 18c8213736cf4113951fbb3520c18183 May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064603280 May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 237510469a8e4e36ad40a34cdf705656 May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064603280-project May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.701338 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '1f09fd70-df36-4976-a829-ebe720c7e516'} May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:01.702257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. May 25 15:06:01.703709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:01.705192 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] Returning 404 to user: Instance 1f09fd70-df36-4976-a829-ebe720c7e516 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:01.705192 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f300dd52-f2cd-48bf-98f8-ab56840f7228 tempest-AttachVolumeShelveTestJSON-2064603280 tempest-AttachVolumeShelveTestJSON-2064603280-project] 10.222.0.74 "GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516" status: 404 len: 111 microversion: 2.20 time: 0.030401 May 25 15:06:01.705192 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 516/1088] 10.222.0.74 () {60 vars in 1276 bytes} [Wed May 25 15:06:01 2022] GET /compute/v2.1/servers/1f09fd70-df36-4976-a829-ebe720c7e516 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 15:06:12.951805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:12.952384 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:12.954428 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:12.955126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:12.959884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:12.960446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:12.961136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:12.962272 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:12.985672 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-555b457b-4526-4cd7-8474-0b1daa551fa7 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/ips" status: 200 len: 149 microversion: 2.1 time: 0.037908 May 25 15:06:12.986663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 573/1089] 10.222.0.74 () {58 vars in 1247 bytes} [Wed May 25 15:06:12 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:15.820594 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d89a6cac-82c1-4079-8967-9ee0e1f74fe6"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:15.822210 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:15.824869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:15.825625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=30 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:15.830422 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:15.830908 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:15.831685 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:15.832124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:18.598387 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:06:18.599020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:06:19.711448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c683cf05-6ac0-4bcb-a871-156697f531ed tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "POST /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.894699 May 25 15:06:19.712168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 517/1090] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:06:15 2022] POST /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments => generated 194 bytes in 3896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:28.560823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:28.561373 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:28.569520 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:28.569969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:28.570771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:28.571212 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:28.655956 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lazy-loading 'services' on Instance uuid 631dc815-ce7a-40b3-9bdb-35f04b2fca01 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:06:28.906788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-260f0472-e40e-433c-a2b6-0870710f7b2e tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments/d89a6cac-82c1-4079-8967-9ee0e1f74fe6" status: 202 len: 0 microversion: 2.1 time: 0.349885 May 25 15:06:28.909122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 574/1091] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:06:28 2022] DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments/d89a6cac-82c1-4079-8967-9ee0e1f74fe6 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:06:28.914475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:28.919141 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:28.920179 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:28.928496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:28.929077 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:28.929993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:28.930431 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:28.962314 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1ea624a3-ec2b-447e-aa18-fb3e873a99fa tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049407 May 25 15:06:28.962910 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 518/1092] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:06:28 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:29.975659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:29.977349 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:29.985408 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:29.988632 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:29.988632 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:29.988632 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:30.017553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c0267dcf-db82-421e-b540-94f75f929c58 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047356 May 25 15:06:30.018113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 575/1093] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:06:29 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:31.029483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:31.030604 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:31.037810 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:31.038267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:31.039086 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:31.039625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:31.070546 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f3a33bd6-4f28-4774-bdc7-0bc1c889f4fd tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045651 May 25 15:06:31.071684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 519/1094] 10.222.0.74 () {58 vars in 1301 bytes} [Wed May 25 15:06:31 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 15:06:31.128890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:31.129911 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:31.135937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:31.136410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:31.137179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:31.137616 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:31.185181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:06:31.493869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-dfa4da90-5f7b-4c4d-9440-6cbf8fc9ea46 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 204 len: 0 microversion: 2.1 time: 0.369347 May 25 15:06:31.494591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 576/1095] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:06:31 2022] DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:06:31.503529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:31.504148 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:31.510330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:31.510822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:31.511596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:31.512039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:31.681973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:31.692454 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-84c75d87-1d79-4a2b-a8d8-0662e28955b9 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1681 microversion: 2.1 time: 0.193401 May 25 15:06:31.693059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 520/1096] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:31 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:06:32.713919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:32.713919 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:32.717144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:32.717720 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:32.718565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:32.719034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:32.884470 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:32.892479 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-850dddfc-e96c-42ca-a08a-b3103eb74597 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1681 microversion: 2.1 time: 0.187040 May 25 15:06:32.893061 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 577/1097] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:32 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:33.910915 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:33.911523 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:33.919700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:33.922324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:33.922324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:33.922324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.059725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:34.067988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6c5d7542-913b-4b3a-bab0-8378860fa963 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1681 microversion: 2.1 time: 0.161351 May 25 15:06:34.068584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 521/1098] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:33 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:34.867456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-49b37192-945d-4c15-aed9-94dd1a580e11 req-488fa2b7-531d-4288-a3b2-aa3ee3f224cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "631dc815-ce7a-40b3-9bdb-35f04b2fca01", "name": "network-vif-deleted", "tag": "f7072705-f1db-4bc8-a3d5-6e626bab50e6"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:34.878801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-49b37192-945d-4c15-aed9-94dd1a580e11 req-488fa2b7-531d-4288-a3b2-aa3ee3f224cd service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:34.879369 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-49b37192-945d-4c15-aed9-94dd1a580e11 req-488fa2b7-531d-4288-a3b2-aa3ee3f224cd service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:34.892027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-49b37192-945d-4c15-aed9-94dd1a580e11 req-488fa2b7-531d-4288-a3b2-aa3ee3f224cd service nova] Creating event network-vif-deleted:f7072705-f1db-4bc8-a3d5-6e626bab50e6 for instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 on hv-cinder-83028 May 25 15:06:34.897139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-49b37192-945d-4c15-aed9-94dd1a580e11 req-488fa2b7-531d-4288-a3b2-aa3ee3f224cd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034307 May 25 15:06:34.897760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 578/1099] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:06:35.085495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:35.086257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:35.093277 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:35.093727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:35.094512 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:35.094981 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:35.160347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd25c0ad8e1c4fa08eca9b6bddeca55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86222a9c32a4f77878dc82c40e38ff1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:06:35.167943 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e5fbc761-bb28-4f91-9f57-e16d2c1ec970 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 200 len: 1327 microversion: 2.1 time: 0.086440 May 25 15:06:35.168515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 522/1100] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:35 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 1327 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:06:36.185951 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:36.187357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:36.194298 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:36.196435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:36.196435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:36.196435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:36.211163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 HTTP/1.1 May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:36.212867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:36.214468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '631dc815-ce7a-40b3-9bdb-35f04b2fca01'} May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:36.215572 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:36.216969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:36.219274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:36.219274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6590ec59-32d4-48d5-8d53-7979b0b35211 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 404 len: 111 microversion: 2.1 time: 0.032828 May 25 15:06:36.219274 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 579/1101] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:36 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:36.224500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c07922f4-e027-493b-8750-a160a9b27760 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '.version_select at 0x7f6fb4a68430>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:36.409018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c07922f4-e027-493b-8750-a160a9b27760 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589977749" status: 202 len: 0 microversion: 2.1 time: 0.188669 May 25 15:06:36.409607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 523/1102] 10.222.0.74 () {58 vars in 1220 bytes} [Wed May 25 15:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589977749 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:06:38.500967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:38.500967 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:38.507325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:38.507802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:38.508577 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:38.509014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:38.522630 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 HTTP/1.1 May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:38.524204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.525819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '631dc815-ce7a-40b3-9bdb-35f04b2fca01'} May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:38.527002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.528490 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:38.530191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:38.530191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-9608c319-9448-49c7-8843-544111c5d827 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 404 len: 111 microversion: 2.1 time: 0.029327 May 25 15:06:38.530191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 580/1103] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:06:38 2022] DELETE /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:38.534464 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:38.535630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 631dc815-ce7a-40b3-9bdb-35f04b2fca01] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:38.543128 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:38.543588 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:38.544364 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:38.544811 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:38.559295 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 HTTP/1.1 May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:06:38.561224 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.562550 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '631dc815-ce7a-40b3-9bdb-35f04b2fca01'} May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:38.563425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. May 25 15:06:38.566003 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:38.567631 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 631dc815-ce7a-40b3-9bdb-35f04b2fca01 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:38.567631 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ea9f0ef3-c8f0-4f3e-9179-330212c3c983 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01" status: 404 len: 111 microversion: 2.1 time: 0.032455 May 25 15:06:38.567631 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 524/1104] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:38 2022] GET /compute/v2.1/servers/631dc815-ce7a-40b3-9bdb-35f04b2fca01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:39.904104 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:39.904644 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:39.910663 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.911146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.912005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.912444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.926779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e HTTP/1.1 May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:39.928320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.929681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '4981ccf8-2f23-4afd-a4e3-db0a929a1e1e'} May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:39.930459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.931732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:39.933067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:39.933067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1d5931b3-7c34-442f-89f5-1a52edc2530d tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 404 len: 111 microversion: 2.1 time: 0.030785 May 25 15:06:39.933067 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 581/1105] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:06:39 2022] DELETE /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:39.939144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:39.939834 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:39.946892 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.947348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.948129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.948570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.962178 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e HTTP/1.1 May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:06:39.963757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.965493 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '4981ccf8-2f23-4afd-a4e3-db0a929a1e1e'} May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:39.966327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. May 25 15:06:39.969111 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:39.970357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 4981ccf8-2f23-4afd-a4e3-db0a929a1e1e could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:39.970357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-64f0e6bd-d020-4795-a00c-e900dd237596 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e" status: 404 len: 111 microversion: 2.1 time: 0.030845 May 25 15:06:39.970357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 525/1106] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:39 2022] GET /compute/v2.1/servers/4981ccf8-2f23-4afd-a4e3-db0a929a1e1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:39.974470 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:39.975001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:39.981097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.981548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.982357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:39.982835 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:39.997042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e HTTP/1.1 May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:40.008338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.009953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e'} May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:40.011068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.012602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:40.013936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:40.013936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3acd3c4d-6a2c-4553-be86-0df582c62189 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 404 len: 111 microversion: 2.1 time: 0.029481 May 25 15:06:40.013936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 582/1107] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:06:39 2022] DELETE /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 15:06:40.015561 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:40.016286 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:40.023806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:40.024328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:40.025080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:40.025541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:40.041678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e HTTP/1.1 May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:06:40.043342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.044975 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e'} May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:40.045829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. May 25 15:06:40.048522 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:40.050211 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:40.050211 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3230477f-391b-4ad5-837a-ff4a4e9e3d09 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e" status: 404 len: 111 microversion: 2.1 time: 0.033384 May 25 15:06:40.050211 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 526/1108] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:40 2022] GET /compute/v2.1/servers/1ecd2c17-098e-4aa9-9ec8-4f05f7e4826e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:41.353048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:41.353787 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:41.360754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.361197 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.361955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.362383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.376600 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a HTTP/1.1 May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:06:41.378132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.380597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '64837a10-d6e9-4fde-9766-7c03759eae0a'} May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:41.381497 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.382798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:06:41.384021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:41.384021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7de10c58-e038-4e7c-9c9e-042441fd08c4 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 404 len: 111 microversion: 2.1 time: 0.030326 May 25 15:06:41.384021 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 583/1109] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:06:41 2022] DELETE /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:41.393039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:06:41.394204 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] [instance: 64837a10-d6e9-4fde-9766-7c03759eae0a] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:06:41.402443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.402925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.403714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:06:41.404155 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:06:41.417602 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] HTTP exception thrown: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Request method failure captured: May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a HTTP/1.1 May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkM0z14SuCifcn-xo9cdz8KCutYyTP_GWN8LzgdMF3IXO6Gqc7RV5Uf5L2F1rJGP0UhkpDpu7T_CCSj9fcT4A2qpqxJofyeNI8_xIUW1_lUhEPWxyLfRs84kKkZrVpHdyqKa3mc9GLMREK9qARnd4sqWCcGFG0ZM6Bu-37zl2BIKxAE May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:06:41.419197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c86222a9c32a4f77878dc82c40e38ff1"}]}] May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: c86222a9c32a4f77878dc82c40e38ff1 May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1659237407 May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: cd25c0ad8e1c4fa08eca9b6bddeca55d May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-AttachVolumeNegativeTest-1659237407-project May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.420896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '64837a10-d6e9-4fde-9766-7c03759eae0a'} May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:06:41.423070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. May 25 15:06:41.430424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:06:41.432235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] Returning 404 to user: Instance 64837a10-d6e9-4fde-9766-7c03759eae0a could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:06:41.432235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3db2d813-ce8f-4b03-9095-109fe4d3c141 tempest-AttachVolumeNegativeTest-1659237407 tempest-AttachVolumeNegativeTest-1659237407-project] 10.222.0.74 "GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a" status: 404 len: 111 microversion: 2.1 time: 0.035167 May 25 15:06:41.432235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 527/1110] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:06:41 2022] GET /compute/v2.1/servers/64837a10-d6e9-4fde-9766-7c03759eae0a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:06:59.845846 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1703274829", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:06:59.851958 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:59.852620 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:59.904984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.network.neutron [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] validate_networks() for None {{(pid=129908) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:07:00.182756 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Flavor limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:07:00.183184 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Image limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:07:00.183667 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Flavor pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:07:00.184082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Image pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:07:00.184866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:07:00.194149 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:00.194602 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:00.195449 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:00.195898 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:00.214681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Getting quotas for project 25b3fac6c0af43ea99fd31e5a72935b6. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:07:00.219304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Getting quotas for user 319e91e5584541d0b9ada922ff610cdc and project 25b3fac6c0af43ea99fd31e5a72935b6. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:07:00.232916 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Going to run 1 instances... {{(pid=129908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:07:00.238621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:07:00.389396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6d13d889-0b04-456b-8530-dc8474559984 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547279 May 25 15:07:00.390047 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 584/1111] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:07:00.400434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-05ed3283-2b0e-4a58-86e0-13b2c90804b1 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:00.401047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-05ed3283-2b0e-4a58-86e0-13b2c90804b1 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:00.403847 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:00.404532 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:00.709076 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-05ed3283-2b0e-4a58-86e0-13b2c90804b1 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:00.715746 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-05ed3283-2b0e-4a58-86e0-13b2c90804b1 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1215 microversion: 2.1 time: 0.319388 May 25 15:07:00.716336 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 528/1112] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:00 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:01.734137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:01.735753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:01.743940 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:01.744390 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:01.745157 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:01.745591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:01.807256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:01.815877 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f9e520e7-b857-4306-b497-f9e5d1f2bc8f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1219 microversion: 2.1 time: 0.086353 May 25 15:07:01.816480 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 585/1113] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:01 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:02.833605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:02.834226 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:02.841304 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:02.841757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:02.842533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:02.842999 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:02.904973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:02.912564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-06d2b8fe-4dad-462a-b8f8-07817d93a044 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1219 microversion: 2.1 time: 0.082915 May 25 15:07:02.913126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 529/1114] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:02 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:03.929411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:03.930069 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:03.937051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:03.937510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:03.938321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:03.938895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:03.999026 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:04.007035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a148c315-eb4b-42c8-882f-6e3fba78d96b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1211 microversion: 2.1 time: 0.081524 May 25 15:07:04.007592 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 586/1115] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:03 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:07:05.024887 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:05.025587 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:05.032132 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:05.032588 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:05.033378 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:05.033820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:05.107607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:05.115271 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9f0158d8-d331-4083-b04a-dccb74c46419 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1275 microversion: 2.1 time: 0.094318 May 25 15:07:05.115937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 530/1116] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:05 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:07:06.132912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:06.133472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:06.140418 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:06.140926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:06.141704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:06.142143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:06.281005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:06.289595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-887c6df9-cf5b-4465-8e6a-0e01b0b9ffd6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.160636 May 25 15:07:06.290181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 587/1117] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:06 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:07.154942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-4c22acac-1eff-4413-8c98-d1449db3c77f req-37bca5e1-02b4-4289-86b5-9875abaac7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c8b9a1-c51f-4970-95a5-b08eeb8b16d1", "tag": "bd082d1d-8e76-4bc7-8b02-0b678301857e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:07.165655 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-4c22acac-1eff-4413-8c98-d1449db3c77f req-37bca5e1-02b4-4289-86b5-9875abaac7a0 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:07.166097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-4c22acac-1eff-4413-8c98-d1449db3c77f req-37bca5e1-02b4-4289-86b5-9875abaac7a0 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:07.183150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-4c22acac-1eff-4413-8c98-d1449db3c77f req-37bca5e1-02b4-4289-86b5-9875abaac7a0 service nova] Creating event network-changed:bd082d1d-8e76-4bc7-8b02-0b678301857e for instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 on hv-cinder-83028 May 25 15:07:07.188809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-4c22acac-1eff-4413-8c98-d1449db3c77f req-37bca5e1-02b4-4289-86b5-9875abaac7a0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037877 May 25 15:07:07.189846 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 531/1118] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:07.313004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:07.313004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:07.317044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:07.317510 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:07.318321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:07.318788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:07.463535 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:07.471008 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-70caa8e1-1365-4e3c-9e9c-b11c75bc5f9b tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.167489 May 25 15:07:07.471573 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 588/1119] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:07 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:08.489521 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:08.490230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:08.497047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:08.497495 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:08.498262 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:08.498734 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:08.628905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:08.636778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5891f4ec-c455-4012-805c-ae711fab50b7 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.152097 May 25 15:07:08.637538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 532/1120] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:08 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:09.653875 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:09.654631 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:09.661917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:09.662359 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:09.663185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:09.663621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:09.798933 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:09.806403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6832bcf5-3e0b-4e7a-9d67-1e5857bc88ec tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.156363 May 25 15:07:09.807001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 589/1121] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:09 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:10.823612 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:10.824357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:10.826771 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:10.834080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:10.834080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:10.834080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:10.834080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:10.966657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:10.974677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c0007e65-7b44-453b-a21d-fa881ea5aed6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.154825 May 25 15:07:10.975491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 533/1122] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:10 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:11.991488 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:11.992198 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:11.995187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:11.995829 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=6 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:12.001433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:12.001433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:12.001433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:12.001433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:12.136706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:12.144469 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-be6784c0-1e97-4d02-80a5-48c7012ee23a tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.156933 May 25 15:07:12.145802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 590/1123] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:11 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:13.163307 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:13.163929 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:13.170377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:13.170872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:13.171651 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:13.172291 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:13.330258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:13.339767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e64bf779-4e2b-4dfc-ad25-0dbd610c3732 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.181223 May 25 15:07:13.340351 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 534/1124] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:13 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:13.366071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-7da0e96b-d3a8-495f-b5a7-f062a375cea7 req-7747e50f-e2d0-4bca-a7f3-1fad4194e526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c8b9a1-c51f-4970-95a5-b08eeb8b16d1", "name": "network-vif-plugged", "status": "completed", "tag": "bd082d1d-8e76-4bc7-8b02-0b678301857e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:13.379980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-7da0e96b-d3a8-495f-b5a7-f062a375cea7 req-7747e50f-e2d0-4bca-a7f3-1fad4194e526 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:13.380416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-7da0e96b-d3a8-495f-b5a7-f062a375cea7 req-7747e50f-e2d0-4bca-a7f3-1fad4194e526 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:13.393648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-7da0e96b-d3a8-495f-b5a7-f062a375cea7 req-7747e50f-e2d0-4bca-a7f3-1fad4194e526 service nova] Creating event network-vif-plugged:bd082d1d-8e76-4bc7-8b02-0b678301857e for instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 on hv-cinder-83028 May 25 15:07:13.399366 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-7da0e96b-d3a8-495f-b5a7-f062a375cea7 req-7747e50f-e2d0-4bca-a7f3-1fad4194e526 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192612 May 25 15:07:13.399829 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 591/1125] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:14.356497 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:14.357904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:14.368027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:14.368555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:14.370146 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:14.370906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:14.538864 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:14.547072 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-722b56f5-7520-45a6-9fac-e4368ae54e46 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.195209 May 25 15:07:14.547669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 535/1126] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:14 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:15.569605 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:15.570331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:15.576508 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:15.576953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:15.577708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:15.578139 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:15.714419 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:15.722035 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7f599f8c-5fb7-4697-a3e2-5a315da419f6 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1315 microversion: 2.1 time: 0.157815 May 25 15:07:15.722608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 592/1127] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:15 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:16.738787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:16.739410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:16.745916 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:16.746372 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:16.747177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:16.747615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:16.887690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:16.887690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f7271297-402c-4e44-99db-ee8094ece783 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1464 microversion: 2.1 time: 0.147776 May 25 15:07:16.887690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 536/1128] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:16 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:16.921897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:16.922430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:16.929586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:16.930029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:16.930833 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:16.931263 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:16.956623 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:07:17.241613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d27f9a84-2f8e-462a-8fbd-c8b0b2933e15 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "DELETE /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 204 len: 0 microversion: 2.1 time: 0.323193 May 25 15:07:17.242301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 593/1129] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:07:16 2022] DELETE /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:07:17.251952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:17.255175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:17.259605 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:17.260334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:17.261311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:17.261806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:17.335585 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1536698567", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "networks": [{"uuid": "594568d5-72fb-4b13-97e4-410ba28dde4f"}]}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:17.387825 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.network.neutron [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] validate_networks() for [('594568d5-72fb-4b13-97e4-410ba28dde4f', None, None, None, None, None)] {{(pid=129908) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:07:17.415087 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:17.422657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-404052f1-06e8-4b81-bc47-94b576ef500e tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1470 microversion: 2.1 time: 0.176353 May 25 15:07:17.423235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 537/1130] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:17 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:17.793845 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Flavor limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:07:17.794270 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Image limits 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:07:17.794788 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Flavor pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:07:17.795206 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Image pref 0:0:0 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:07:17.795622 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.virt.hardware [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:07:17.805327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:17.805769 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:17.806560 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:17.807034 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:17.824123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Getting quotas for project a177f93d752a47d893da6989db08a99e. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:07:17.828014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Getting quotas for user e700894113df4af99e9edb3071a5f38d and project a177f93d752a47d893da6989db08a99e. Resources: {'instances', 'ram', 'cores'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:07:17.839125 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Going to run 1 instances... {{(pid=129908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:07:17.841808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:07:17.971726 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a842e56c-bc06-4f67-8939-5b0a106aeff0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640306 May 25 15:07:17.972435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 594/1131] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 15:07:17.982445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-28f4e14f-d06a-4b01-8316-34b35fe7fe0b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:17.983230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-28f4e14f-d06a-4b01-8316-34b35fe7fe0b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:18.035914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-28f4e14f-d06a-4b01-8316-34b35fe7fe0b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:18.042568 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-28f4e14f-d06a-4b01-8316-34b35fe7fe0b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1219 microversion: 2.1 time: 0.064037 May 25 15:07:18.043441 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 538/1132] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:17 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:07:18.440770 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:18.441433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:18.447926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:18.453407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:18.453407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:18.453407 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:18.579154 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:18.587806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8b7bbdf6-b3e3-46f6-b96b-5698b0ff6f57 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1470 microversion: 2.1 time: 0.150916 May 25 15:07:18.588309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 595/1133] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:18 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:19.065790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:19.066932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:19.074147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:19.074525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:19.075491 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:19.077717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:19.144501 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:19.152070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b5970146-b9a0-489f-aea5-d065449b598c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1223 microversion: 2.1 time: 0.090175 May 25 15:07:19.152698 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 539/1134] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:19 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:19.444158 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-a606bf60-065a-411b-8205-a8a43264b70c req-c0c63322-72e2-4c95-9171-e0ed7bc838b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c8b9a1-c51f-4970-95a5-b08eeb8b16d1", "name": "network-vif-deleted", "tag": "bd082d1d-8e76-4bc7-8b02-0b678301857e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:19.454892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-a606bf60-065a-411b-8205-a8a43264b70c req-c0c63322-72e2-4c95-9171-e0ed7bc838b6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:19.455338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-a606bf60-065a-411b-8205-a8a43264b70c req-c0c63322-72e2-4c95-9171-e0ed7bc838b6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:19.467314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-a606bf60-065a-411b-8205-a8a43264b70c req-c0c63322-72e2-4c95-9171-e0ed7bc838b6 service nova] Creating event network-vif-deleted:bd082d1d-8e76-4bc7-8b02-0b678301857e for instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 on hv-cinder-83028 May 25 15:07:19.472839 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-a606bf60-065a-411b-8205-a8a43264b70c req-c0c63322-72e2-4c95-9171-e0ed7bc838b6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032308 May 25 15:07:19.473688 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 596/1135] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:19.607903 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:19.608547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:19.615677 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:19.616070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:19.616833 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:19.617300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:19.680074 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:19.687966 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-eed84739-99f3-4e16-be78-059b8b244ec3 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1300 microversion: 2.1 time: 0.086643 May 25 15:07:19.688538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 540/1136] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:19 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:20.169259 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:20.169955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:20.176450 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:20.176896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:20.177666 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:20.178105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:20.240715 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:20.248122 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d7ec0826-c12d-4443-9530-d4936dabb957 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1271 microversion: 2.1 time: 0.083094 May 25 15:07:20.248691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 597/1137] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:20 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:20.706415 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:20.708167 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:20.716377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:20.716826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:20.717595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:20.718028 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:20.751652 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:20.752094 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:20.752537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lazy-loading 'fault' on Instance uuid 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:07:20.796433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319e91e5584541d0b9ada922ff610cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b3fac6c0af43ea99fd31e5a72935b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:20.804325 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e7af8c62-41e7-4f63-9c09-a51ae4eb7d44 tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 200 len: 1305 microversion: 2.1 time: 0.102762 May 25 15:07:20.804904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 541/1138] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:20 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:21.265828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:21.266441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:21.273887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:21.274337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:21.275130 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:21.275561 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:21.424796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:21.433277 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-caa1aa04-8284-4da2-ba87-69107a2802a4 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.171286 May 25 15:07:21.434327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 598/1139] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:21 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:21.821969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:21.822524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] [instance: 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:21.829100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:21.829640 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:21.830504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:21.831026 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:21.844377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] HTTP exception thrown: Instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 could not be found. May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Request method failure captured: May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 HTTP/1.1 May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkYQll1fIZO_f8ppBS1TvflZMVvXiR4d1plQ3vYiM4EJwSCIuyZIEucjmVtrfyJ8edcqX3mpCAvnQvSnk9OGSg4kQFhqOIR3SFKDS5rPJP-B0QswAWbTozutEIbJJWsMqicT8NZA24jqVf_8y-8G_O0JCM7EnslW_HrjKvJanQJ35ao May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 25b3fac6c0af43ea99fd31e5a72935b6 May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-VolumesNegativeTest-1188794389 May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:07:21.846027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_25b3fac6c0af43ea99fd31e5a72935b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/25b3fac6c0af43ea99fd31e5a72935b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/25b3fac6c0af43ea99fd31e5a72935b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/25b3fac6c0af43ea99fd31e5a72935b6"}]}] May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-VolumesNegativeTest-1188794389 May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 25b3fac6c0af43ea99fd31e5a72935b6 May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-VolumesNegativeTest-1188794389 May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-VolumesNegativeTest-1188794389-project May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: 319e91e5584541d0b9ada922ff610cdc May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-VolumesNegativeTest-1188794389-project May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 could not be found. May 25 15:07:21.848308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '37c8b9a1-c51f-4970-95a5-b08eeb8b16d1'} May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 could not be found. May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:07:21.849249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 could not be found. May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 could not be found. May 25 15:07:21.850872 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:07:21.854100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] Returning 404 to user: Instance 37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:07:21.854100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-09ca269e-05c1-4ec1-aa95-b7d653c2bf5f tempest-VolumesNegativeTest-1188794389 tempest-VolumesNegativeTest-1188794389-project] 10.222.0.74 "GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1" status: 404 len: 111 microversion: 2.1 time: 0.030075 May 25 15:07:21.854100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 542/1140] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:21 2022] GET /compute/v2.1/servers/37c8b9a1-c51f-4970-95a5-b08eeb8b16d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:07:22.372326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-d61d6af1-7be2-41d7-8b0e-80aa55ef460b req-087667fe-fa6e-439a-b8f0-cf49bfb9f548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65327b77-3dc1-40d7-999c-9c0666ca4dc3", "tag": "5eda492e-fd01-4928-b889-f0834907e174"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:22.381179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d61d6af1-7be2-41d7-8b0e-80aa55ef460b req-087667fe-fa6e-439a-b8f0-cf49bfb9f548 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:22.384551 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d61d6af1-7be2-41d7-8b0e-80aa55ef460b req-087667fe-fa6e-439a-b8f0-cf49bfb9f548 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:22.397063 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-d61d6af1-7be2-41d7-8b0e-80aa55ef460b req-087667fe-fa6e-439a-b8f0-cf49bfb9f548 service nova] Creating event network-changed:5eda492e-fd01-4928-b889-f0834907e174 for instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 on hv-cinder-83028 May 25 15:07:22.401934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-d61d6af1-7be2-41d7-8b0e-80aa55ef460b req-087667fe-fa6e-439a-b8f0-cf49bfb9f548 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035129 May 25 15:07:22.402799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 599/1141] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:07:22.457082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:22.458253 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:22.472230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:22.472230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:22.472230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:22.472230 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:22.601367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:22.609021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5d2e87a1-4d80-41e0-9e5a-f65953da7dbb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.156916 May 25 15:07:22.613416 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 543/1142] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:22 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:23.627430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:23.628132 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:23.634811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:23.635255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:23.636009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:23.636441 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:23.769057 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:23.776855 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d6158d26-a976-4c8a-bf71-3691f5f6ef6e tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.154154 May 25 15:07:23.777430 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 600/1143] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:23 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:24.793120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:24.793732 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:24.800298 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:24.800873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:24.801638 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:24.802073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:24.933208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:24.940966 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1fe79da1-8c43-4bdb-a8e4-ac16787f0f72 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.151745 May 25 15:07:24.942021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 544/1144] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:24 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:25.958890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:25.959498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:25.966246 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:25.966729 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:25.967502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:25.967969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:26.105053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:26.113166 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-52e03491-b268-4100-9ac6-66f19e965fe2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.158604 May 25 15:07:26.113775 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 601/1145] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:25 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:27.130202 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:27.130756 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:27.137339 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:27.137791 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:27.138562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:27.139034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:27.275844 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:27.283709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f98e1be9-01bf-4dc4-8745-1ab4e208353f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.157453 May 25 15:07:27.284263 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 545/1146] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:27 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:28.301758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:28.302494 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:28.306177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:28.306942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=6 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:28.311060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:28.311537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:28.312400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:28.312913 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:28.318179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:28.448003 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:28.455530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3f9f094b-f9d6-4165-a182-f3a94c3a97c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.158097 May 25 15:07:28.456118 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 602/1147] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:28 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:29.473771 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:29.474385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:29.476560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:29.486486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:29.486486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:29.486486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:29.486486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:29.490841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-13d883c4-3c24-4511-994e-82ce3e8fdc05 req-24c473dd-aae2-4fdb-b189-d3e10cdd1547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65327b77-3dc1-40d7-999c-9c0666ca4dc3", "name": "network-vif-plugged", "status": "completed", "tag": "5eda492e-fd01-4928-b889-f0834907e174"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:29.500799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-13d883c4-3c24-4511-994e-82ce3e8fdc05 req-24c473dd-aae2-4fdb-b189-d3e10cdd1547 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:29.501245 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-13d883c4-3c24-4511-994e-82ce3e8fdc05 req-24c473dd-aae2-4fdb-b189-d3e10cdd1547 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:29.512273 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-13d883c4-3c24-4511-994e-82ce3e8fdc05 req-24c473dd-aae2-4fdb-b189-d3e10cdd1547 service nova] Creating event network-vif-plugged:5eda492e-fd01-4928-b889-f0834907e174 for instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 on hv-cinder-83028 May 25 15:07:29.517375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-13d883c4-3c24-4511-994e-82ce3e8fdc05 req-24c473dd-aae2-4fdb-b189-d3e10cdd1547 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031062 May 25 15:07:29.531869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 603/1148] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:07:29.617440 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:29.625453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d825cfe8-aba8-4da0-8a18-9df2ff53edc8 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.156221 May 25 15:07:29.634796 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 546/1149] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:29 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:30.642941 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:30.643569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:30.646864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:30.652004 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:30.652454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:30.653241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:30.653677 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:30.786187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:30.793552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-efdd7bbf-e811-4137-9330-eef8dfe0d4fe tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1319 microversion: 2.1 time: 0.155235 May 25 15:07:30.798595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 604/1150] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:30 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:07:31.810890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:07:31.811494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:31.813866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=45 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:31.818617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:31.819166 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:31.819930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:31.820370 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:31.838352 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=100 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:31.951423 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:07:31.959412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d4e228fd-ba0e-47f5-a97b-bde1b8a80397 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1508 microversion: 2.1 time: 0.152791 May 25 15:07:31.959973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 547/1151] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:07:31 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:07:53.602126 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e24b7f-c2a5-457c-b2b8-5d9fb299e0ae", "device": "/dev/sdb"}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:07:53.604586 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:07:53.606847 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=12 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:53.611780 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:53.612226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:53.613377 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:07:53.613484 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:07:54.491269 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-25c82c24-7d6e-472c-9a8a-87514cbe5aa6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "POST /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893378 May 25 15:07:54.491887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 605/1152] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:07:53 2022] POST /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:08:05.118100 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:08:05.118873 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:08:23.440941 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:23.441445 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:23.443462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:23.444108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:23.449437 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:23.453062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:23.453062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:23.453062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:23.534232 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lazy-loading 'services' on Instance uuid 65327b77-3dc1-40d7-999c-9c0666ca4dc3 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:08:23.797766 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-45b0c3fd-4afb-4a51-bb83-0a9d54a7f1b6 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "DELETE /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3/os-volume_attachments/09e24b7f-c2a5-457c-b2b8-5d9fb299e0ae" status: 202 len: 0 microversion: 2.1 time: 0.360690 May 25 15:08:23.798365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 548/1153] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:08:23 2022] DELETE /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3/os-volume_attachments/09e24b7f-c2a5-457c-b2b8-5d9fb299e0ae => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:08:25.966743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=3 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:25.967504 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:25.971612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:25.972198 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:25.981645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:25.982927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:25.982927 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:25.983311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:26.007679 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:08:26.266937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e794de8d-4a16-4a89-9250-2e374aed8c49 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "DELETE /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 204 len: 0 microversion: 2.1 time: 0.301296 May 25 15:08:26.267536 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 606/1154] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:08:25 2022] DELETE /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:08:26.277303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:26.278005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:26.285035 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:26.285479 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:26.286273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:26.286755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:26.427180 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:26.434924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c98c1ed3-e9b6-47e2-8161-ef420e45e9a2 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1514 microversion: 2.1 time: 0.162693 May 25 15:08:26.435498 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 549/1155] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:26 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:27.454923 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:27.456020 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:27.464144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:27.464596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:27.465370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:27.465808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:27.593481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:27.601009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-93f28698-1511-4586-8686-f7945a6392fb tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1514 microversion: 2.1 time: 0.151251 May 25 15:08:27.601581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 607/1156] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:27 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:28.617952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:28.618607 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:28.625228 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:28.625676 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:28.626460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:28.626927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:28.762018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:28.769064 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6a75b876-7505-489e-b589-df74c9dca585 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1514 microversion: 2.1 time: 0.154948 May 25 15:08:28.769631 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 550/1157] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:28 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:29.036442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-d0240186-d7d9-4bf6-b8f3-86e18135f088 req-646a6843-1881-4e25-874d-d4c7fe29fdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65327b77-3dc1-40d7-999c-9c0666ca4dc3", "name": "network-vif-deleted", "tag": "5eda492e-fd01-4928-b889-f0834907e174"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:29.045232 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d0240186-d7d9-4bf6-b8f3-86e18135f088 req-646a6843-1881-4e25-874d-d4c7fe29fdc2 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.045679 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-d0240186-d7d9-4bf6-b8f3-86e18135f088 req-646a6843-1881-4e25-874d-d4c7fe29fdc2 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.057095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-d0240186-d7d9-4bf6-b8f3-86e18135f088 req-646a6843-1881-4e25-874d-d4c7fe29fdc2 service nova] Creating event network-vif-deleted:5eda492e-fd01-4928-b889-f0834907e174 for instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 on hv-cinder-83028 May 25 15:08:29.062666 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-d0240186-d7d9-4bf6-b8f3-86e18135f088 req-646a6843-1881-4e25-874d-d4c7fe29fdc2 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 May 25 15:08:29.063268 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 608/1158] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:08:29.785152 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:29.785790 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:29.792316 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.792759 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.793524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.793960 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.827114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:29.827567 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:29.828016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lazy-loading 'fault' on Instance uuid 65327b77-3dc1-40d7-999c-9c0666ca4dc3 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:08:29.870662 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:29.878353 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d2ceb9f1-4d9b-407b-b9bd-5e3f7fe3931c tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 200 len: 1309 microversion: 2.1 time: 0.096948 May 25 15:08:29.878952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 551/1159] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:29 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:30.896183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:30.896885 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 65327b77-3dc1-40d7-999c-9c0666ca4dc3] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:30.903659 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:30.904112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:30.905387 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:30.905821 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:30.919060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] HTTP exception thrown: Instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 could not be found. May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Request method failure captured: May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 HTTP/1.1 May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkYiZV_dISIVSvo273gKBHI7xlKKQPnAJ_zZvYeaSo_A0AQz3kDI9yQtfz4RJGTDlnhCc0Y5DPvrTm59D6tLVk37zZYsPHTFceuCB_xr31HNywJmRvMKGknkLdUZFTeahbX7RPTSdldL4-WMx7S5-jb0VNP_b0HGKXYy3AN2HykTreM May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: a177f93d752a47d893da6989db08a99e May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-769825155 May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:08:30.921331 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a177f93d752a47d893da6989db08a99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a177f93d752a47d893da6989db08a99e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a177f93d752a47d893da6989db08a99e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a177f93d752a47d893da6989db08a99e"}]}] May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-VolumesSnapshotTestJSON-769825155 May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: a177f93d752a47d893da6989db08a99e May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-769825155 May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-VolumesSnapshotTestJSON-769825155-project May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: e700894113df4af99e9edb3071a5f38d May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-VolumesSnapshotTestJSON-769825155-project May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 could not be found. May 25 15:08:30.923054 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': '65327b77-3dc1-40d7-999c-9c0666ca4dc3'} May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 could not be found. May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:08:30.924005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 could not be found. May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 could not be found. May 25 15:08:30.925400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:08:30.926567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Returning 404 to user: Instance 65327b77-3dc1-40d7-999c-9c0666ca4dc3 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:08:30.926567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bad35bd9-7897-459c-8ebd-adb58280543b tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3" status: 404 len: 111 microversion: 2.1 time: 0.030777 May 25 15:08:30.926567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 609/1160] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:30 2022] GET /compute/v2.1/servers/65327b77-3dc1-40d7-999c-9c0666ca4dc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:08:42.480991 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-156757434", "imageRef": "2cacf9c9-9a50-4fcc-9ce4-e1262241bfad", "flavorRef": "452", "networks": [{"uuid": "594568d5-72fb-4b13-97e4-410ba28dde4f"}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:42.488302 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=10 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:42.488971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:42.536251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] validate_networks() for [('594568d5-72fb-4b13-97e4-410ba28dde4f', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:08:42.985398 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:08:42.985817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:08:42.986312 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:08:42.986740 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:08:42.987242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:08:42.996141 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.996585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:42.997376 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:42.997802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:43.015101 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Getting quotas for project a177f93d752a47d893da6989db08a99e. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:08:43.019298 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Getting quotas for user e700894113df4af99e9edb3071a5f38d and project a177f93d752a47d893da6989db08a99e. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:08:43.030710 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:08:43.033016 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cacf9c9-9a50-4fcc-9ce4-e1262241bfad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:08:43.147876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d6abaa5c-5bba-4931-9db0-85857c219b26 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670761 May 25 15:08:43.148720 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 552/1161] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:08:43.158581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2f1449ec-ae5c-4543-90d2-74b5156e1cb3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:43.159249 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2f1449ec-ae5c-4543-90d2-74b5156e1cb3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:43.161545 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:43.162205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:43.215466 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2f1449ec-ae5c-4543-90d2-74b5156e1cb3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:43.222241 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2f1449ec-ae5c-4543-90d2-74b5156e1cb3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1218 microversion: 2.1 time: 0.067615 May 25 15:08:43.222850 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 610/1162] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:43 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:44.240070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:44.240700 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:44.250678 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:44.251147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:44.251896 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:44.252451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:44.323129 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:44.331770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-31a1be7c-9173-416b-b15e-627eef7ecada tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1222 microversion: 2.1 time: 0.096067 May 25 15:08:44.332575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 553/1163] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:44 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:45.349335 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:45.350064 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:45.360000 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:45.360442 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:45.361415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:45.362137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:45.431597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:45.439994 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ef4a02da-2dfe-46b4-a217-101ed489fab9 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1288 microversion: 2.1 time: 0.094593 May 25 15:08:45.440608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 611/1164] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:45 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:46.458744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:46.459405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:46.466227 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:46.466804 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:46.468198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:46.468731 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:46.609636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:46.617351 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-3f713683-af31-48b5-9798-3988e0247a6f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.162596 May 25 15:08:46.617920 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 554/1165] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:46 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:46.996470 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-decef4a5-23d3-4074-bdca-cab413f05886 req-27e968ce-7d3e-406b-99de-795e3a13a35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f27d4a-c8e1-404f-902e-74062f948dfd", "tag": "b25c7d65-67b1-4508-b6d1-8828bf88fe7c"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:47.006246 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-decef4a5-23d3-4074-bdca-cab413f05886 req-27e968ce-7d3e-406b-99de-795e3a13a35f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:47.010060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-decef4a5-23d3-4074-bdca-cab413f05886 req-27e968ce-7d3e-406b-99de-795e3a13a35f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:47.018928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-decef4a5-23d3-4074-bdca-cab413f05886 req-27e968ce-7d3e-406b-99de-795e3a13a35f service nova] Creating event network-changed:b25c7d65-67b1-4508-b6d1-8828bf88fe7c for instance 21f27d4a-c8e1-404f-902e-74062f948dfd on hv-cinder-83028 May 25 15:08:47.024055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-decef4a5-23d3-4074-bdca-cab413f05886 req-27e968ce-7d3e-406b-99de-795e3a13a35f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031877 May 25 15:08:47.024655 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 612/1166] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:08:47.634090 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:47.634747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:47.641375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:47.641822 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:47.642597 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:47.643073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:47.784547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:47.792509 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fdc5f3cf-39ae-4d3e-bae1-2740189d89fa tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.162214 May 25 15:08:47.793101 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 555/1167] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:47 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:48.810235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:48.810973 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:48.817899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:48.818357 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:48.819171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:48.819613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:48.956236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:48.963849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-58a2c097-f046-433d-b5d5-ae0b5bdfdf2d tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.158652 May 25 15:08:48.964438 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 613/1168] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:48 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:49.980870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:49.981504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:49.988630 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:49.989082 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:49.989858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:49.990300 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:50.126371 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:50.133953 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-19fd907a-a140-4708-b620-a5d74e0f3ff1 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.156978 May 25 15:08:50.134525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 556/1169] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:49 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:51.151014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:51.151621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:51.158443 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:51.158925 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:51.159799 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:51.160342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:51.296783 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:51.305070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-16a136e2-2e4b-4ef5-ac3d-a565b5beb885 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.158031 May 25 15:08:51.305690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 614/1170] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:51 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:52.323689 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:52.324235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:52.331391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:52.331963 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:52.333274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:52.333776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:52.468275 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:52.476282 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-65991434-eece-4557-8629-94ad9c44e415 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.156586 May 25 15:08:52.476859 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 557/1171] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:52 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:53.493171 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:53.493787 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:53.496379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:53.501291 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:53.501735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:53.502514 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:53.502974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:53.639136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:53.647322 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f6c21047-a3c2-41b3-afd8-daac05a01b29 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.157924 May 25 15:08:53.648234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 615/1172] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:53 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:08:53.944627 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-28d41cab-adb5-402d-b1d7-609c6b63c2fd req-a2f1eead-ee20-4dab-95a3-07b41b828353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f27d4a-c8e1-404f-902e-74062f948dfd", "name": "network-vif-plugged", "status": "completed", "tag": "b25c7d65-67b1-4508-b6d1-8828bf88fe7c"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:53.948301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:53.948985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:53.962019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-28d41cab-adb5-402d-b1d7-609c6b63c2fd req-a2f1eead-ee20-4dab-95a3-07b41b828353 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:53.966877 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-28d41cab-adb5-402d-b1d7-609c6b63c2fd req-a2f1eead-ee20-4dab-95a3-07b41b828353 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:53.974208 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-28d41cab-adb5-402d-b1d7-609c6b63c2fd req-a2f1eead-ee20-4dab-95a3-07b41b828353 service nova] Creating event network-vif-plugged:b25c7d65-67b1-4508-b6d1-8828bf88fe7c for instance 21f27d4a-c8e1-404f-902e-74062f948dfd on hv-cinder-83028 May 25 15:08:53.979562 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-28d41cab-adb5-402d-b1d7-609c6b63c2fd req-a2f1eead-ee20-4dab-95a3-07b41b828353 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039270 May 25 15:08:53.980174 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 558/1173] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:08:54.665113 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:54.665678 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:54.672829 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:54.673273 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:54.674050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:54.674485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:54.811008 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:54.819111 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3afc8d8d-d075-4e6b-91cb-a8eea80d48e0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.158050 May 25 15:08:54.819690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 616/1174] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:54 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:55.837299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:55.838012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:55.844800 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:55.845242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:55.846332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:55.846845 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:55.989389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:55.997007 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f566e772-51b8-46dd-9c72-5ab84f7c4b93 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1318 microversion: 2.1 time: 0.165534 May 25 15:08:55.997584 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 559/1175] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:55 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:57.014204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:08:57.014861 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:57.021708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:57.022160 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:57.025804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:57.025804 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:57.164444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:08:57.172257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-254813df-1aca-4fe2-8687-950e4d39aebc tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1507 microversion: 2.1 time: 0.162053 May 25 15:08:57.172829 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 617/1176] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:08:57 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:08:57.188816 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20270381-f157-4c11-89b2-07c8080effeb", "device": "/dev/sdb"}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:08:57.190395 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:08:57.197194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:57.197641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:57.198419 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:08:57.198891 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:08:57.945743 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5149809a-15f9-49ab-bb6d-b87adb053828 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "POST /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760946 May 25 15:08:57.946371 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 560/1177] 10.222.0.74 () {60 vars in 1322 bytes} [Wed May 25 15:08:57 2022] POST /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:21.135502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:21.136058 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:21.138155 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=18 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:21.138841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=38 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:21.143545 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:21.143996 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:21.144823 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:21.145256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:21.226607 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lazy-loading 'services' on Instance uuid 21f27d4a-c8e1-404f-902e-74062f948dfd {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:09:21.477819 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-13a9ec56-cdfc-4696-aba6-133007c52d0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "DELETE /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd/os-volume_attachments/20270381-f157-4c11-89b2-07c8080effeb" status: 202 len: 0 microversion: 2.1 time: 0.346135 May 25 15:09:21.478436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 618/1178] 10.222.0.74 () {58 vars in 1415 bytes} [Wed May 25 15:09:21 2022] DELETE /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd/os-volume_attachments/20270381-f157-4c11-89b2-07c8080effeb => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:09:23.645758 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:23.646524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:23.650500 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:23.651122 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:23.657233 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:23.665382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:23.665382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:23.665382 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:23.685218 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Going to try to terminate instance {{(pid=129907) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:09:23.983782 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f7e184c9-e943-4b0c-b542-918d40dc0c0a tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "DELETE /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 204 len: 0 microversion: 2.1 time: 0.339283 May 25 15:09:23.984399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 561/1179] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:09:23 2022] DELETE /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:09:23.993537 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:23.998899 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:24.000991 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:24.001437 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:24.002719 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:24.003188 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:24.132175 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:24.139714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-508465c9-5f69-43c1-9c8d-8dcebb1ae2c0 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1513 microversion: 2.1 time: 0.150879 May 25 15:09:24.140285 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 619/1180] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:09:23 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:25.156520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:25.157221 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:25.164301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:25.164752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:25.165517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:25.165961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:25.296348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:25.303959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-370ea940-3c1b-47b4-b8e5-a31859fb346f tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1513 microversion: 2.1 time: 0.151729 May 25 15:09:25.304534 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 562/1181] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:09:25 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:26.321930 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:26.322681 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:26.329608 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.330060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.331512 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.331949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.461549 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:26.469123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-87dfc529-c729-4259-9534-5a7ecc1e0393 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1513 microversion: 2.1 time: 0.151120 May 25 15:09:26.469687 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 620/1182] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:09:26 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:26.607177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-760ad43e-2190-4503-9ec1-179a07c60cde req-3ae7186d-07bc-4c67-98c8-c26110e8a06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f27d4a-c8e1-404f-902e-74062f948dfd", "name": "network-vif-deleted", "tag": "b25c7d65-67b1-4508-b6d1-8828bf88fe7c"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:09:26.616122 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-760ad43e-2190-4503-9ec1-179a07c60cde req-3ae7186d-07bc-4c67-98c8-c26110e8a06e service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:26.617162 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-760ad43e-2190-4503-9ec1-179a07c60cde req-3ae7186d-07bc-4c67-98c8-c26110e8a06e service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:26.627438 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-760ad43e-2190-4503-9ec1-179a07c60cde req-3ae7186d-07bc-4c67-98c8-c26110e8a06e service nova] Creating event network-vif-deleted:b25c7d65-67b1-4508-b6d1-8828bf88fe7c for instance 21f27d4a-c8e1-404f-902e-74062f948dfd on hv-cinder-83028 May 25 15:09:26.632396 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-760ad43e-2190-4503-9ec1-179a07c60cde req-3ae7186d-07bc-4c67-98c8-c26110e8a06e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028917 May 25 15:09:26.632993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 563/1183] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:09:27.485763 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:27.486386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:27.493288 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:27.493813 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:27.494596 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:27.495050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:27.528873 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:27.529209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:27.529844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lazy-loading 'fault' on Instance uuid 21f27d4a-c8e1-404f-902e-74062f948dfd {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:09:27.571943 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e700894113df4af99e9edb3071a5f38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a177f93d752a47d893da6989db08a99e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:09:27.580022 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-42cd0260-63ea-44cb-add3-58c01266e3e5 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 200 len: 1308 microversion: 2.1 time: 0.098054 May 25 15:09:27.581314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 621/1184] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:09:27 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:09:28.598598 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:09:28.599254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] [instance: 21f27d4a-c8e1-404f-902e-74062f948dfd] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:09:28.606737 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:28.607184 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:28.607946 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:09:28.608379 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:09:28.621987 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] HTTP exception thrown: Instance 21f27d4a-c8e1-404f-902e-74062f948dfd could not be found. May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Request method failure captured: May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd HTTP/1.1 May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkYiZV_dISIVSvo273gKBHI7xlKKQPnAJ_zZvYeaSo_A0AQz3kDI9yQtfz4RJGTDlnhCc0Y5DPvrTm59D6tLVk37zZYsPHTFceuCB_xr31HNywJmRvMKGknkLdUZFTeahbX7RPTSdldL4-WMx7S5-jb0VNP_b0HGKXYy3AN2HykTreM May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: a177f93d752a47d893da6989db08a99e May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-VolumesSnapshotTestJSON-769825155 May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:09:28.623609 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_a177f93d752a47d893da6989db08a99e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/a177f93d752a47d893da6989db08a99e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a177f93d752a47d893da6989db08a99e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/a177f93d752a47d893da6989db08a99e"}]}] May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-VolumesSnapshotTestJSON-769825155 May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: a177f93d752a47d893da6989db08a99e May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-769825155 May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-VolumesSnapshotTestJSON-769825155-project May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: e700894113df4af99e9edb3071a5f38d May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-VolumesSnapshotTestJSON-769825155-project May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance 21f27d4a-c8e1-404f-902e-74062f948dfd could not be found. May 25 15:09:28.625296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': '21f27d4a-c8e1-404f-902e-74062f948dfd'} May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f27d4a-c8e1-404f-902e-74062f948dfd could not be found. May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:09:28.626450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f27d4a-c8e1-404f-902e-74062f948dfd could not be found. May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f27d4a-c8e1-404f-902e-74062f948dfd could not be found. May 25 15:09:28.628744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:09:28.630249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] Returning 404 to user: Instance 21f27d4a-c8e1-404f-902e-74062f948dfd could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:09:28.630249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8b5425ca-3718-447d-bf30-dfb584de3cd3 tempest-VolumesSnapshotTestJSON-769825155 tempest-VolumesSnapshotTestJSON-769825155-project] 10.222.0.74 "GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd" status: 404 len: 111 microversion: 2.1 time: 0.030586 May 25 15:09:28.630249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 564/1185] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:09:28 2022] GET /compute/v2.1/servers/21f27d4a-c8e1-404f-902e-74062f948dfd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:09:38.607226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:09:38.607735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:09:54.118227 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:09:54.118845 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:10:49.763093 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=10 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:49.766628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:49.982707 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a0d0c4bb-5f7c-4a99-90e7-ce18184af455 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Action: 'create', calling method: .version_select at 0x7f6fb9971af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-610303337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGHrCcZXPCYZ7z+Uc8t0wdsGmKIzY1uPt4sTwncRCkGRJCqeI5R0l5aUUB54V/8ZeR4ob+7dF6kJEPhXtxlVfqyrOCuCyhowNamhxuaMocOXvre7ZknOZaGk5aCzaGoWw=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:10:49.999892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-a0d0c4bb-5f7c-4a99-90e7-ce18184af455 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Getting quotas for project 6405d7039f25476f81b98903d2af54f2. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:10:50.005406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-a0d0c4bb-5f7c-4a99-90e7-ce18184af455 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Getting quotas for user cc778dde80744f318367d27fde29d47c and project 6405d7039f25476f81b98903d2af54f2. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:10:50.101340 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a0d0c4bb-5f7c-4a99-90e7-ce18184af455 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.340114 May 25 15:10:50.106957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 622/1186] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 15:10:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:11:13.561201 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:13.561948 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:13.566009 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-745777124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-610303337", "security_groups": [{"name": "tempest-secgroup-smoke-293421668"}], "networks": [{"uuid": "7c8a2e76-5c4f-40d4-9193-e0b868c847b4"}], "block_device_mapping_v2": [{"uuid": "9421ee2c-37f5-4d93-8ec9-19fc4d50a1c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:13.785930 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] validate_networks() for [('7c8a2e76-5c4f-40d4-9193-e0b868c847b4', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:11:14.143537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:11:14.143901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:11:14.144846 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:11:14.145283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:11:14.145689 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:11:14.154425 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:14.154961 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:14.155752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:14.156177 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:14.173193 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Getting quotas for project 6405d7039f25476f81b98903d2af54f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:11:14.177068 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Getting quotas for user cc778dde80744f318367d27fde29d47c and project 6405d7039f25476f81b98903d2af54f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:11:14.235529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:11:14.237668 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9421ee2c-37f5-4d93-8ec9-19fc4d50a1c7',volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:11:14.704018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [d1e48aca-4ff1-4d30-b5cd-be2a73aae6da] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:11:15.711188 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [d1e48aca-4ff1-4d30-b5cd-be2a73aae6da] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 58926. May 25 15:11:15.715292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ef92b8e6-cd29-4e91-b213-65fda7948c90 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.156008 May 25 15:11:15.715939 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 565/1187] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:11:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 2157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:11:15.723474 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46d68f95-866b-4760-b52b-cad7c19ba36a] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:11:15.723979 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=4 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:15.724694 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:15.728530 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-4e048dc6-d8b6-4372-a292-1ea91036af1f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:15.729147 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-4e048dc6-d8b6-4372-a292-1ea91036af1f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:15.891676 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-4e048dc6-d8b6-4372-a292-1ea91036af1f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:15.899527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-4e048dc6-d8b6-4372-a292-1ea91036af1f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1087 microversion: 2.1 time: 0.177432 May 25 15:11:15.900082 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 623/1188] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:15 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1087 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:16.917861 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:16.918391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:16.924544 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:16.932667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:16.932667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:16.932667 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:16.989107 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:16.996541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-28bdb0c1-8f43-4458-9bb7-12fb707b9576 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1137 microversion: 2.1 time: 0.083328 May 25 15:11:16.997098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 566/1189] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:16 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:18.014884 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:18.015491 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:18.024192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:18.024645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:18.025414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:18.026090 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:18.041370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] [46d68f95-866b-4760-b52b-cad7c19ba36a] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 58946. May 25 15:11:18.088569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:18.096374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-51f253d7-9888-47c5-9256-3d45245c7849 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1185 microversion: 2.1 time: 0.085526 May 25 15:11:18.097148 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 624/1190] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:18 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:19.115296 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:19.116668 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:19.124970 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:19.125547 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:19.126475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:19.139047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:19.282412 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:19.290240 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-caeb981c-78e8-4051-882b-fc67e8ceaded tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1270 microversion: 2.1 time: 0.179233 May 25 15:11:19.290858 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 567/1191] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:19 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:20.307398 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:20.310462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:20.323653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:20.323653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:20.323653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:20.323653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:20.393297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-88e7c07b-15c6-4f4d-b069-60322bed6886 req-c2e10d13-e5a2-4ef6-af61-98bcb4ad70cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:20.402008 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-88e7c07b-15c6-4f4d-b069-60322bed6886 req-c2e10d13-e5a2-4ef6-af61-98bcb4ad70cd service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:20.402460 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-88e7c07b-15c6-4f4d-b069-60322bed6886 req-c2e10d13-e5a2-4ef6-af61-98bcb4ad70cd service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:20.416548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-88e7c07b-15c6-4f4d-b069-60322bed6886 req-c2e10d13-e5a2-4ef6-af61-98bcb4ad70cd service nova] Creating event network-changed:a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1 for instance e1055520-e770-40f7-b42f-6f19a84c5cb9 on hv-cinder-83028 May 25 15:11:20.424397 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-88e7c07b-15c6-4f4d-b069-60322bed6886 req-c2e10d13-e5a2-4ef6-af61-98bcb4ad70cd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116855 May 25 15:11:20.425011 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 568/1192] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:11:20.479183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:20.487452 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3e8c3747-db56-42b8-ab47-9633ed4a8712 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.184174 May 25 15:11:20.488670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 625/1193] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:20 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:21.508470 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:21.509268 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:21.515619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:21.516062 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:21.516828 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:21.517263 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:21.665075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:21.672701 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-74033aad-0df1-4081-b697-50c3fcd64823 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.169881 May 25 15:11:21.673266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 569/1194] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:21 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:22.690291 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:22.690880 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:22.697842 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:22.698284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:22.699072 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:22.699501 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:22.828698 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:22.836686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-26827489-09bc-4f76-9cd5-b335fef67f5a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.150369 May 25 15:11:22.837237 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 626/1195] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:22 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:23.853274 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:23.853879 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:23.860356 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:23.860803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:23.861560 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:23.861993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:23.997120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:24.006119 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6f2d9f01-cdcd-49d5-9164-1e7245a53194 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.155728 May 25 15:11:24.006119 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 570/1196] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:23 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:25.021934 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:25.022539 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:25.029042 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:25.029481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:25.030236 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:25.030686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:25.162410 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:25.169849 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-428ccff9-77a9-455a-8701-1fd953a8d841 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.151813 May 25 15:11:25.170415 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 627/1197] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:25 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:26.186802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:26.187421 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:26.189362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:26.190019 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:26.196067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:26.198781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:26.198781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:26.198781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:26.326600 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:26.339147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ffcc6c57-013d-4cad-b09c-4035918639fb tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.153391 May 25 15:11:26.339147 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 571/1198] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:26 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:27.353027 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:27.358526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:27.358526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:27.361015 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:27.361464 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:27.362229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:27.362691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:27.496146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:27.503830 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2f74476f-b2c4-467b-a590-11588feb2b74 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.154644 May 25 15:11:27.504400 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 628/1199] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:27 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:28.521380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:28.521997 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:28.528541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:28.528990 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:28.529768 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:28.530195 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:28.663387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:28.671096 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-c8b63954-839f-45ce-8b2c-527b39fd990f tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.154155 May 25 15:11:28.671669 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 572/1200] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:28 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:29.688187 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:29.688735 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:29.695834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:29.696283 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:29.697055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:29.697495 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:29.830445 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:29.838440 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-da60e0ff-c71d-435b-9ef9-3cae9b22a243 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.154492 May 25 15:11:29.839038 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 629/1201] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:29 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:30.831558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-70abad0c-5346-492c-b1dc-f02e617dd27d req-033288ce-9ae4-4f34-bef5-47a52a9ba9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "name": "network-vif-plugged", "status": "completed", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:30.841391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-70abad0c-5346-492c-b1dc-f02e617dd27d req-033288ce-9ae4-4f34-bef5-47a52a9ba9fe service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:30.841780 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-70abad0c-5346-492c-b1dc-f02e617dd27d req-033288ce-9ae4-4f34-bef5-47a52a9ba9fe service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:30.852805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-70abad0c-5346-492c-b1dc-f02e617dd27d req-033288ce-9ae4-4f34-bef5-47a52a9ba9fe service nova] Creating event network-vif-plugged:a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1 for instance e1055520-e770-40f7-b42f-6f19a84c5cb9 on hv-cinder-83028 May 25 15:11:30.855917 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:30.876472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:30.877023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-70abad0c-5346-492c-b1dc-f02e617dd27d req-033288ce-9ae4-4f34-bef5-47a52a9ba9fe service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030096 May 25 15:11:30.877023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 573/1202] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:11:30.877215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:30.877215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:30.877215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:30.877215 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:31.000138 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:31.008463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1d6b8133-5aba-495c-baed-b82ae20d2e61 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.156475 May 25 15:11:31.009028 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 630/1203] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:30 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:32.026451 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:32.027179 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:32.033815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:32.034268 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:32.035092 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:32.035530 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:32.185613 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:32.194963 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7f696d78-353a-4741-a28a-ef4f718a8e60 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1258 microversion: 2.1 time: 0.173085 May 25 15:11:32.195552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 574/1204] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:32 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:33.211523 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:33.212158 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:33.218805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:33.219257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:33.220014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:33.220444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:33.354181 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:33.361683 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-29aae87d-7ca6-4791-a525-845d2fb2f36d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1441 microversion: 2.1 time: 0.154267 May 25 15:11:33.362282 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 631/1205] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:33 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:33.378272 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:11:33.378921 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:11:33.385393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:33.385842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:33.386595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:33.387071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:33.514337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:11:33.522430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d5d9efc9-f5fd-4f32-9205-dfa9cefd5f52 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1441 microversion: 2.1 time: 0.148123 May 25 15:11:33.523033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 575/1206] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:11:33 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1441 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:11:35.878454 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-7e46a38c-b2f6-42ce-b0b3-25b000bd9448 req-ecf4fe58-46da-4452-811b-22995df81d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:11:35.886434 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-7e46a38c-b2f6-42ce-b0b3-25b000bd9448 req-ecf4fe58-46da-4452-811b-22995df81d7a service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:11:35.886894 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-7e46a38c-b2f6-42ce-b0b3-25b000bd9448 req-ecf4fe58-46da-4452-811b-22995df81d7a service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:11:35.897937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-7e46a38c-b2f6-42ce-b0b3-25b000bd9448 req-ecf4fe58-46da-4452-811b-22995df81d7a service nova] Creating event network-changed:a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1 for instance e1055520-e770-40f7-b42f-6f19a84c5cb9 on hv-cinder-83028 May 25 15:11:35.903345 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-7e46a38c-b2f6-42ce-b0b3-25b000bd9448 req-ecf4fe58-46da-4452-811b-22995df81d7a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082545 May 25 15:11:35.904001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 632/1207] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:12:58.616161 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:12:58.616858 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:13:05.127993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:13:05.128739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:13:14.126757 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:13:14.127350 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:13:50.706711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:50.707596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=54 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:50.711673 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:13:50.712202 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:50.718781 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:50.723434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:50.723434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:50.723434 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:50.743765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lazy-loading 'flavor' on Instance uuid e1055520-e770-40f7-b42f-6f19a84c5cb9 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:13:50.966968 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b21e8845-c858-413e-a350-cbf05bf21395 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "POST /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9/action" status: 202 len: 0 microversion: 2.1 time: 0.261906 May 25 15:13:50.967619 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 576/1208] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:13:50 2022] POST /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:13:50.976078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46d68f95-866b-4760-b52b-cad7c19ba36a] AMQP server on 10.222.0.74:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 25 15:13:50.976720 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=22 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:50.977470 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=50 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:50.982563 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:50.983333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:50.989565 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:50.990133 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:50.991050 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:50.991485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:51.124806 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:51.132329 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5ef08345-ecf1-49f7-b8e9-b157c7760f20 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.160258 May 25 15:13:51.132889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 633/1209] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:50 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:52.148210 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aadaa76d-ba8d-4b5b-928f-a5a1a19192f4] AMQP server on 10.222.0.74:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 25 15:13:52.151958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:52.152666 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:52.158982 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:52.159437 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:52.160205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:52.160641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:52.294459 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:52.301971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-253c9887-5ed4-4017-a16b-e32c8613106b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.155326 May 25 15:13:52.302525 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 577/1210] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:52 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:53.318926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:53.319528 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:53.327714 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:53.328162 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:53.328936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:53.329373 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:53.346023 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] [46d68f95-866b-4760-b52b-cad7c19ba36a] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59052. May 25 15:13:53.458506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:53.466072 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1d60af0a-3411-4ad7-9d77-2dd3049b8c82 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.151105 May 25 15:13:53.466654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 634/1211] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:53 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:54.483174 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:54.483788 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:54.491904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:54.492353 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:54.493126 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:54.493563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:54.499641 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] [aadaa76d-ba8d-4b5b-928f-a5a1a19192f4] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59056. May 25 15:13:54.627958 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:54.635704 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-544e1afa-f83f-4075-8e25-58a727b58524 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.157071 May 25 15:13:54.636266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 578/1212] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:54 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:55.656079 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:55.656661 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:55.663219 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:55.664091 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:55.664438 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:55.664873 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:55.796796 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:55.804365 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c8a0455f-5494-4c25-98c6-42e28f90f7ee tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.152298 May 25 15:13:55.804935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 635/1213] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:55 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:56.822175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:56.823401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:56.829861 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:56.830310 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:56.831112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:56.831549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:56.961324 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:56.968927 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-86e721ff-bd9a-4052-bcd9-ca900a3f3102 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.150599 May 25 15:13:56.969496 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 579/1214] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:56 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:57.985391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:57.985987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:57.992503 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:57.992969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:57.993708 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:57.994136 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:58.129970 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:58.137986 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-25a9ec86-d877-4aef-81fb-013c0162b040 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.156447 May 25 15:13:58.138552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 636/1215] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:57 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:13:59.155585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:13:59.156203 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:13:59.162890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:59.163342 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:59.164112 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:13:59.164555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:13:59.294384 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:13:59.302681 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8eb8a88c-a210-4c33-8fa2-48ef54082f4a tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.150932 May 25 15:13:59.303239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 580/1216] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:13:59 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:00.320235 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:00.320852 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:00.328134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:00.328595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:00.329391 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:00.329834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:00.464660 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:00.472172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5895e2aa-fee9-4c00-93cd-5bd49e6b143c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.155800 May 25 15:14:00.472731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 637/1217] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:00 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:01.489340 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:01.490050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:01.497138 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:01.497585 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:01.498352 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:01.498818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:01.629528 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:01.637073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-32db6612-23a8-4f93-837e-b00051acc157 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.151647 May 25 15:14:01.637644 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 581/1218] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:01 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:02.654612 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:02.655203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:02.661753 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:02.662199 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:02.662985 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:02.663414 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:02.794048 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:02.801649 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-99755d8c-7a5c-4e77-9771-d7889757fcc7 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.151533 May 25 15:14:02.802221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 638/1219] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:02 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:03.818912 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:03.819629 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:03.826474 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:03.826952 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:03.827709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:03.828137 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:03.969121 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:03.976717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1e6e7b66-7420-4743-98c8-266147c234cd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1566 microversion: 2.1 time: 0.161693 May 25 15:14:03.977297 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 582/1220] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:03 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:04.993312 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:04.993931 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:05.000511 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:05.000966 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:05.001739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:05.002183 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:05.128916 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:05.136569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ed730154-a014-4be0-89a6-75691d0f0af6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1567 microversion: 2.1 time: 0.147144 May 25 15:14:05.137143 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 639/1221] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:04 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:05.153308 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:14:05.158806 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:05.160377 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:05.160829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:05.161596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:05.162038 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:05.467169 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-f76f4aca-6e22-4a7a-8d8a-0299fca71275 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "POST /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9/action" status: 202 len: 0 microversion: 2.1 time: 0.318206 May 25 15:14:05.467792 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 583/1222] 10.222.0.74 () {60 vars in 1277 bytes} [Wed May 25 15:14:05 2022] POST /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:14:05.476104 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:05.477456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:05.482937 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:05.483386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:05.484144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:05.484574 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:05.616654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:05.624232 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c26ea8a3-974e-4339-b92c-8fe30b8519e5 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1515 microversion: 2.1 time: 0.152125 May 25 15:14:05.624801 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 640/1223] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:05 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:14:06.641834 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:06.642453 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:06.649168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:06.649615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:06.650385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:06.651365 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:06.783238 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:06.790815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8f7316c0-3252-4834-a176-06a2481dd89b tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1517 microversion: 2.1 time: 0.153218 May 25 15:14:06.792056 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 584/1224] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:06 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:07.478396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-b4155839-4e02-47e5-abd1-0d040b545457 req-207ff92e-5ec5-4afb-b388-cb23021adfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:14:07.486423 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b4155839-4e02-47e5-abd1-0d040b545457 req-207ff92e-5ec5-4afb-b388-cb23021adfd7 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:07.486895 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-b4155839-4e02-47e5-abd1-0d040b545457 req-207ff92e-5ec5-4afb-b388-cb23021adfd7 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:07.498706 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.compute.server_external_events [req-b4155839-4e02-47e5-abd1-0d040b545457 req-207ff92e-5ec5-4afb-b388-cb23021adfd7 service nova] Unable to find a host for instance e1055520-e770-40f7-b42f-6f19a84c5cb9. Dropping event network-vif-unplugged {{(pid=129908) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 15:14:07.499598 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-b4155839-4e02-47e5-abd1-0d040b545457 req-207ff92e-5ec5-4afb-b388-cb23021adfd7 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086425 May 25 15:14:07.500179 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 641/1225] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 15:14:07.810399 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:07.811049 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:07.817672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:07.818067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:07.818964 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:07.819409 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:07.952581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:07.960216 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fbe7c89f-d947-408b-8cd8-c80e623a8765 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1517 microversion: 2.1 time: 0.154961 May 25 15:14:07.960785 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 585/1226] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:07 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:08.977383 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:08.978002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:08.984568 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:08.985016 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:08.985789 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:08.986230 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:09.117691 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:09.125924 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a553fa57-b5c9-4fcd-ac0e-52bc48a35ad0 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.152450 May 25 15:14:09.126496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 642/1227] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:08 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:10.142869 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:10.143484 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:10.150074 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:10.151173 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:10.151942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:10.152374 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:10.280363 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:10.287974 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1637a9be-2091-4187-a38e-33b51c3cecd8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.148955 May 25 15:14:10.288571 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 586/1228] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:10 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:11.304739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:11.305347 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:11.312422 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:11.312869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:11.313654 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:11.314089 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:11.448774 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:11.456486 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e8fad935-961a-4a75-a201-670653bb7d27 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.155666 May 25 15:14:11.457051 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 643/1229] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:11 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:12.478433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:12.479087 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:12.485576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:12.486020 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:12.486805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:12.487236 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:12.614969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:12.623040 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b8500f4e-b256-4cf3-84ce-9530563d4778 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.148508 May 25 15:14:12.623610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 587/1230] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:12 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:13.640468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:13.641096 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:13.647646 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:13.648097 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:13.648859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:13.649292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:13.787760 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:13.795292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-94cc5c98-b33e-4d03-af38-ec7b03da9f09 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.159196 May 25 15:14:13.795863 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 644/1231] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:13 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:14.813214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:14.813823 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:14.820408 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:14.820859 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:14.821648 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:14.822089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:14.953568 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:14.961285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9d4db960-e700-427a-b944-95fdafaa15dd tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.151993 May 25 15:14:14.961993 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 588/1232] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:14 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:15.978427 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:15.979071 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:15.986070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:15.986521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:15.987330 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:15.987766 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:16.119861 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:16.128123 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d5af8569-3004-44d3-84f3-e5e0650c71d8 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.153590 May 25 15:14:16.128694 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 645/1233] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:15 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:17.145180 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:17.145774 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:17.153143 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:17.153590 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:17.154353 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:17.154826 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:17.174187 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:17.287071 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:17.294985 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-7f50d2fa-270f-48b5-9005-98b09b954ee4 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.153638 May 25 15:14:17.295549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 589/1234] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:17 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:18.312864 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:18.313542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:18.320291 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:18.320747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:18.321531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:18.321988 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:18.451362 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:18.458900 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e5c7358c-75b0-4b7f-97ed-449692282591 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.150046 May 25 15:14:18.459463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 646/1235] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:18 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:19.475905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:19.476510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:19.483070 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:19.483541 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:19.484303 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:19.484744 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:19.555901 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-568d3efe-33b2-4032-872a-57bf7417bbd5 req-65415cf1-7723-4a0f-9e24-bc08ba520ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "name": "network-vif-plugged", "status": "completed", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:14:19.565436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-568d3efe-33b2-4032-872a-57bf7417bbd5 req-65415cf1-7723-4a0f-9e24-bc08ba520ff0 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:19.565889 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-568d3efe-33b2-4032-872a-57bf7417bbd5 req-65415cf1-7723-4a0f-9e24-bc08ba520ff0 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:19.577052 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-568d3efe-33b2-4032-872a-57bf7417bbd5 req-65415cf1-7723-4a0f-9e24-bc08ba520ff0 service nova] Creating event network-vif-plugged:a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1 for instance e1055520-e770-40f7-b42f-6f19a84c5cb9 on hv-cinder-83028 May 25 15:14:19.582309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-568d3efe-33b2-4032-872a-57bf7417bbd5 req-65415cf1-7723-4a0f-9e24-bc08ba520ff0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030000 May 25 15:14:19.582876 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 647/1236] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:14:19.622483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:19.630310 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-51df8ea4-fdb3-4e78-a688-57249510307d tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.158344 May 25 15:14:19.630923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 590/1237] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:19 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:20.648192 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:20.648814 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:20.655807 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:20.656258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:20.657029 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:20.657467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:20.788033 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:20.795764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-a3b802c5-31d6-44ce-b7e0-5b56abf683a6 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1573 microversion: 2.1 time: 0.152274 May 25 15:14:20.796339 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 648/1238] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:20 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:14:21.813553 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:14:21.814249 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:14:21.816554 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=33 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:21.821410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:21.825456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:21.825456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:14:21.825456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:14:21.955712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:14:21.963291 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-78748799-301d-4b8e-9c0e-1d4ecb11e582 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1560 microversion: 2.1 time: 0.153794 May 25 15:14:21.964520 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 591/1239] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:14:21 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:15:59.064776 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=32 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:59.065914 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=88 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:59.070853 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-84ef48e5-992c-463a-8982-5f894dc7c786 req-86271211-1808-4d64-90b8-5638bd408c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:15:59.071398 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:15:59.071522 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:15:59.076345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:59.077095 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=14 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:59.084061 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-84ef48e5-992c-463a-8982-5f894dc7c786 req-86271211-1808-4d64-90b8-5638bd408c7c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:15:59.084508 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-84ef48e5-992c-463a-8982-5f894dc7c786 req-86271211-1808-4d64-90b8-5638bd408c7c service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:15:59.088984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:15:59.088984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:15:59.089380 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:15:59.089887 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:15:59.098185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-84ef48e5-992c-463a-8982-5f894dc7c786 req-86271211-1808-4d64-90b8-5638bd408c7c service nova] Creating event network-changed:a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1 for instance e1055520-e770-40f7-b42f-6f19a84c5cb9 on hv-cinder-83028 May 25 15:15:59.104278 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-84ef48e5-992c-463a-8982-5f894dc7c786 req-86271211-1808-4d64-90b8-5638bd408c7c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038922 May 25 15:15:59.105205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 592/1240] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:15:59.121670 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:15:59.451805 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ff407b76-4458-4211-9fa0-9519b851f204 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 204 len: 0 microversion: 2.1 time: 0.389312 May 25 15:15:59.452584 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 649/1241] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:15:59 2022] DELETE /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:15:59.462711 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:15:59.463430 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:15:59.470901 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:15:59.471357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:15:59.472150 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:15:59.472603 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:15:59.621682 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:15:59.630770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b147f8c1-e2a9-4b1e-b9a5-583fc20d8890 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1447 microversion: 2.1 time: 0.172583 May 25 15:15:59.631367 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 593/1242] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:15:59 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:00.649632 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:00.650337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:00.657205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:00.657656 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:00.658435 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:00.658907 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:00.802838 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:00.811712 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1be474fd-85bb-44d5-8851-92cf72163019 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1447 microversion: 2.1 time: 0.166271 May 25 15:16:00.818713 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 650/1243] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:00 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:01.828924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:01.830057 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:01.836634 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:01.840886 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:01.840886 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:01.840886 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:01.991900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:01.991900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-40dd4512-448c-4056-aa42-abf949f38256 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1447 microversion: 2.1 time: 0.164223 May 25 15:16:01.991900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 594/1244] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:01 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:02.022262 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-f7e60715-767b-4203-8035-962d79681c68 req-d4f35865-db97-416e-80e1-c3219dc4b61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1055520-e770-40f7-b42f-6f19a84c5cb9", "name": "network-vif-deleted", "tag": "a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:16:02.030915 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-f7e60715-767b-4203-8035-962d79681c68 req-d4f35865-db97-416e-80e1-c3219dc4b61f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:02.033379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-f7e60715-767b-4203-8035-962d79681c68 req-d4f35865-db97-416e-80e1-c3219dc4b61f service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:02.044378 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-f7e60715-767b-4203-8035-962d79681c68 req-d4f35865-db97-416e-80e1-c3219dc4b61f service nova] Creating event network-vif-deleted:a3e6e0ee-8dd8-4712-9cee-5ae09833c5d1 for instance e1055520-e770-40f7-b42f-6f19a84c5cb9 on hv-cinder-83028 May 25 15:16:02.049955 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-f7e60715-767b-4203-8035-962d79681c68 req-d4f35865-db97-416e-80e1-c3219dc4b61f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 May 25 15:16:02.050552 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 651/1245] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:16:03.006494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:03.007144 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:03.013575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:03.014044 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:03.014849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:03.015288 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:03.046552 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:03.047033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:03.047483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.objects.instance [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lazy-loading 'fault' on Instance uuid e1055520-e770-40f7-b42f-6f19a84c5cb9 {{(pid=129907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:16:03.087988 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc778dde80744f318367d27fde29d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6405d7039f25476f81b98903d2af54f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:03.096073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-86054d97-e0f5-464d-b581-8aff77986b77 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 200 len: 1223 microversion: 2.1 time: 0.093495 May 25 15:16:03.096638 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 595/1246] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:03 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:04.114172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:04.114893 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] [instance: e1055520-e770-40f7-b42f-6f19a84c5cb9] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:04.121014 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:04.121457 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:04.122221 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:04.122672 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:04.135570 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] HTTP exception thrown: Instance e1055520-e770-40f7-b42f-6f19a84c5cb9 could not be found. May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Request method failure captured: May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 HTTP/1.1 May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkby0iFZTLteoCYMPgobCOmXWnu-fSlPEXOiNSyukSoTBApLt5u5xlGe5jFmrn1z1T-bTznW2Nuic9BE3sXikw8LaRhDJPotpHkZyG4zHDz3GPYK3QeYo_Ds_CjmF9rejjEZbg4hedz-SAQJjouT3xkodsOx3RnNg1-n3m5A7yVWgno May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 6405d7039f25476f81b98903d2af54f2 May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-TestShelveInstance-800418909 May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:16:04.137234 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_6405d7039f25476f81b98903d2af54f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/6405d7039f25476f81b98903d2af54f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6405d7039f25476f81b98903d2af54f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/6405d7039f25476f81b98903d2af54f2"}]}] May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-TestShelveInstance-800418909 May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 6405d7039f25476f81b98903d2af54f2 May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-TestShelveInstance-800418909 May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-TestShelveInstance-800418909-project May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: cc778dde80744f318367d27fde29d47c May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-TestShelveInstance-800418909-project May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance e1055520-e770-40f7-b42f-6f19a84c5cb9 could not be found. May 25 15:16:04.139177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'e1055520-e770-40f7-b42f-6f19a84c5cb9'} May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1055520-e770-40f7-b42f-6f19a84c5cb9 could not be found. May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:16:04.140303 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1055520-e770-40f7-b42f-6f19a84c5cb9 could not be found. May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1055520-e770-40f7-b42f-6f19a84c5cb9 could not be found. May 25 15:16:04.142250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:16:04.144505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Returning 404 to user: Instance e1055520-e770-40f7-b42f-6f19a84c5cb9 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:16:04.144505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-74ac1d9b-f2b1-4226-b0a9-2888e2090e01 tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9" status: 404 len: 111 microversion: 2.1 time: 0.029069 May 25 15:16:04.144505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 652/1247] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:04 2022] GET /compute/v2.1/servers/e1055520-e770-40f7-b42f-6f19a84c5cb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:16:04.384433 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-be2e232a-760b-41b2-842d-325b737fca2c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] Calling method '.version_select at 0x7f6fb46dd310>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:04.458309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-be2e232a-760b-41b2-842d-325b737fca2c tempest-TestShelveInstance-800418909 tempest-TestShelveInstance-800418909-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-610303337" status: 202 len: 0 microversion: 2.1 time: 0.077734 May 25 15:16:04.458922 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 596/1248] 10.222.0.74 () {58 vars in 1250 bytes} [Wed May 25 15:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-610303337 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 15:16:18.624730 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:16:18.625337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:16:25.135828 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:16:25.136502 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:16:26.822477 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:26.823968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:26.995749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-162973d0-40bd-4fab-bca3-a1c0d3418164 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Action: 'create', calling method: .version_select at 0x7f6fb998a4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1765953191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOgvfciHE7cDQUl3GjlWqxqKIdf0YVwslOBO8bHu3mdi74VW/oxk5m5YT4nSpjMFP/dy9FKBAL2VNjsi429M6hwG5TCU+o0yNUd3beqwawtCNJL3uSUKnEKbRaxdvIWHQ=="}} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:16:27.011778 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-162973d0-40bd-4fab-bca3-a1c0d3418164 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:16:27.015890 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.quota [None req-162973d0-40bd-4fab-bca3-a1c0d3418164 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for user d13d9b9d3e48455082a74eaa3f1b4f18 and project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'key_pairs'} {{(pid=129908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:16:27.095731 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-162973d0-40bd-4fab-bca3-a1c0d3418164 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280066 May 25 15:16:27.096337 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 653/1249] 10.222.0.74 () {60 vars in 1158 bytes} [Wed May 25 15:16:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:16:40.136226 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:16:40.136671 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:16:51.817393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=22 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:51.818154 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:51.822123 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-53583771", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1765953191", "security_groups": [{"name": "tempest-secgroup-smoke-1823770904"}], "block_device_mapping_v2": [{"uuid": "c3a5deb0-a24c-437e-8566-12203b3df1a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8b32613-7bd9-40e5-935b-b1d37f6ebd8a"}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:16:52.034066 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] validate_networks() for [('f8b32613-7bd9-40e5-935b-b1d37f6ebd8a', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:16:52.496900 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:16:52.497330 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:16:52.497812 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:16:52.498258 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:16:52.498703 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:16:52.508175 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:52.512456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:52.512456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:52.512456 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:52.527507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:16:52.531695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for user d13d9b9d3e48455082a74eaa3f1b4f18 and project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:16:52.590696 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:16:52.592827 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3a5deb0-a24c-437e-8566-12203b3df1a1',volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:16:53.030085 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-cd2f99ce-e715-4cb5-9d7b-5a5f8e57244a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.214495 May 25 15:16:53.031038 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 597/1250] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:16:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:16:53.041252 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bb4cf6ae-8783-4f97-ba00-f8641bd08454 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:53.041965 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bb4cf6ae-8783-4f97-ba00-f8641bd08454 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:53.044362 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=4 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:53.045011 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:53.155986 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bb4cf6ae-8783-4f97-ba00-f8641bd08454 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:53.163101 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bb4cf6ae-8783-4f97-ba00-f8641bd08454 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1093 microversion: 2.1 time: 0.125476 May 25 15:16:53.163526 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 654/1251] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:53 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1093 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:54.180624 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:54.181234 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:54.187435 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:54.187904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:54.188658 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:54.189098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:54.253755 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:54.261264 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1e4926d5-9408-46aa-82cc-61bbd6a8f2dc tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1143 microversion: 2.1 time: 0.085261 May 25 15:16:54.261832 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 598/1252] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:54 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:55.278645 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:55.279273 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:55.286278 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:55.286746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:55.287506 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:55.287936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:55.350298 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:55.358013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-283d8649-91a7-41c2-aa8d-e1b43f664733 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1191 microversion: 2.1 time: 0.083230 May 25 15:16:55.358591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 655/1253] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:55 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:56.376259 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:56.378410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:56.384263 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:56.384799 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:56.385583 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:56.386018 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:56.528705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:56.537467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-5f58e04a-cb55-41ba-924b-44fc11fb413b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1277 microversion: 2.1 time: 0.165069 May 25 15:16:56.538320 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 599/1254] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:56 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:16:57.294856 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-8fb0b812-6e2e-4ef6-a049-94a5ae1e58b3 req-1ab849df-ee9d-4f37-a8a2-a9fb971d5a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15e8f6d-219f-4312-8be2-fd99185b1fb7", "tag": "c7d42b86-c989-4645-bc89-66cc727cc05e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:16:57.303862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8fb0b812-6e2e-4ef6-a049-94a5ae1e58b3 req-1ab849df-ee9d-4f37-a8a2-a9fb971d5a3e service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:57.304309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8fb0b812-6e2e-4ef6-a049-94a5ae1e58b3 req-1ab849df-ee9d-4f37-a8a2-a9fb971d5a3e service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:57.316762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-8fb0b812-6e2e-4ef6-a049-94a5ae1e58b3 req-1ab849df-ee9d-4f37-a8a2-a9fb971d5a3e service nova] Creating event network-changed:c7d42b86-c989-4645-bc89-66cc727cc05e for instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 on hv-cinder-83028 May 25 15:16:57.321857 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-8fb0b812-6e2e-4ef6-a049-94a5ae1e58b3 req-1ab849df-ee9d-4f37-a8a2-a9fb971d5a3e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090698 May 25 15:16:57.322749 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 656/1255] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:16:57.559498 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:57.560108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:57.567239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:57.567684 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:57.568548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:57.568978 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:57.702021 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:57.710257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-e7b15806-28b4-499c-8f93-d3b446f42cec tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.154906 May 25 15:16:57.710866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 600/1256] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:57 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:16:58.732053 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:58.732750 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:58.739532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:58.739982 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:58.740744 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:58.741177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:58.869376 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:16:58.876820 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-7990faeb-e17b-4f5d-a2ba-89b2acab5d2c tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.149414 May 25 15:16:58.877381 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 657/1257] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:58 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:16:59.894008 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:16:59.895226 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:16:59.901723 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:59.902171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:16:59.902966 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:16:59.903402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:00.034625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:00.042692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-af33871e-93ee-4524-98be-7ddb9ec9ea55 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.152533 May 25 15:17:00.043266 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 601/1258] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:16:59 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:01.060593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:01.061209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:01.067732 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:01.068177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:01.068939 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:01.069372 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:01.197862 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:01.205336 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-2c5d327a-07bb-4cf7-ad8f-36a775d76436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.148773 May 25 15:17:01.207736 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 658/1259] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:01 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:02.223336 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:02.223995 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:02.230457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:02.230937 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:02.231695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:02.232132 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:02.359709 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:02.367818 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-811dd5e6-d3bb-404f-a260-c68f47ae0349 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.148896 May 25 15:17:02.368375 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 602/1260] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:02 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:03.385182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:03.385791 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:03.388379 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:03.393364 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:03.393815 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:03.394619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:03.395087 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:03.527536 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:03.535496 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bd36ceec-f3fe-4f58-a64c-e349770540fd tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.153630 May 25 15:17:03.536059 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 659/1261] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:03 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:04.551725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:04.552334 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:04.554347 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:04.555059 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:04.560984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:04.561436 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:04.562198 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:04.562632 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:04.695498 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:04.702906 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ed20af31-1d7f-4714-9e01-cb62ee0bfd7b tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.155116 May 25 15:17:04.703467 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 603/1262] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:04 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:05.720273 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:05.720886 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:05.728009 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:05.728457 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:05.729225 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:05.729658 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:05.862223 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:05.869789 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-cbab296d-04d5-4ebf-bc15-98714cb582ef tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.153393 May 25 15:17:05.870396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 660/1263] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:05 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:06.887349 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:06.887933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:06.895289 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:06.895751 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:06.896555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:06.896991 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:07.025595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:07.033063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-21de544d-e57f-4af2-abf9-b93d3e514fa4 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.149812 May 25 15:17:07.033625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 604/1264] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:06 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:08.049980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:08.050599 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:08.057475 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:08.057926 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:08.058724 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:08.059167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:08.189423 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:08.197396 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-023ee557-b16e-4c5e-a5c2-de5c2e1a216a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.151277 May 25 15:17:08.197981 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 661/1265] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:08 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:09.215849 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:09.216410 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:09.223614 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:09.224097 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:09.224876 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:09.225317 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:09.354971 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:09.362549 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-de439179-f027-41a5-a114-a164fcc6f073 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.150708 May 25 15:17:09.363246 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 605/1266] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:09 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:10.379936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:10.380583 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:10.387304 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:10.387758 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:10.388581 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:10.389019 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:10.517628 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:10.526879 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-77cf549c-fc15-4146-8f65-c71b34e37d42 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.151295 May 25 15:17:10.529439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 662/1267] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:10 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:10.631422 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-4601476f-e047-4935-9dbb-eff8a58dd3b6 req-6fbb41b7-b362-4246-9e2f-215e94fc2507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15e8f6d-219f-4312-8be2-fd99185b1fb7", "name": "network-vif-plugged", "status": "completed", "tag": "c7d42b86-c989-4645-bc89-66cc727cc05e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:17:10.640089 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-4601476f-e047-4935-9dbb-eff8a58dd3b6 req-6fbb41b7-b362-4246-9e2f-215e94fc2507 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:10.640537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-4601476f-e047-4935-9dbb-eff8a58dd3b6 req-6fbb41b7-b362-4246-9e2f-215e94fc2507 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:10.652057 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-4601476f-e047-4935-9dbb-eff8a58dd3b6 req-6fbb41b7-b362-4246-9e2f-215e94fc2507 service nova] Creating event network-vif-plugged:c7d42b86-c989-4645-bc89-66cc727cc05e for instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 on hv-cinder-83028 May 25 15:17:10.657106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-4601476f-e047-4935-9dbb-eff8a58dd3b6 req-6fbb41b7-b362-4246-9e2f-215e94fc2507 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030051 May 25 15:17:10.657692 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 606/1268] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:17:11.543742 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:11.544338 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:11.550865 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:11.551311 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:11.552074 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:11.552505 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:11.685743 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:11.693406 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b08fcf08-1763-47af-818b-fa99d7f90621 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1265 microversion: 2.1 time: 0.153561 May 25 15:17:11.693995 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 663/1269] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:11 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:12.711687 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:12.712292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:12.718487 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:12.718967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:12.719724 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:12.720158 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:12.850726 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:12.858478 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-29d55492-2f0f-44b8-9b9c-db44b43db518 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1450 microversion: 2.1 time: 0.152149 May 25 15:17:12.859134 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 607/1270] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:12 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:12.874462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:17:12.875119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:17:12.882153 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:12.882594 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:12.883579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:12.884013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:13.017373 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:17:13.024798 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-0db8df86-c5b2-4e2a-ac9c-d0a8c89be2b2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1450 microversion: 2.1 time: 0.154111 May 25 15:17:13.025360 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 664/1271] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:17:12 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:17:15.236354 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-189e643d-a42d-44c9-91a1-796fdc3046a3 req-223e6d12-197c-4595-a873-ed0927e40741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15e8f6d-219f-4312-8be2-fd99185b1fb7", "tag": "c7d42b86-c989-4645-bc89-66cc727cc05e"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:17:15.245942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-189e643d-a42d-44c9-91a1-796fdc3046a3 req-223e6d12-197c-4595-a873-ed0927e40741 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:17:15.246380 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-189e643d-a42d-44c9-91a1-796fdc3046a3 req-223e6d12-197c-4595-a873-ed0927e40741 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:17:15.260733 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-189e643d-a42d-44c9-91a1-796fdc3046a3 req-223e6d12-197c-4595-a873-ed0927e40741 service nova] Creating event network-changed:c7d42b86-c989-4645-bc89-66cc727cc05e for instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 on hv-cinder-83028 May 25 15:17:15.266171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-189e643d-a42d-44c9-91a1-796fdc3046a3 req-223e6d12-197c-4595-a873-ed0927e40741 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033498 May 25 15:17:15.266820 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 608/1272] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:18:14.136690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:18:14.137405 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:18:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:19:29.448897 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=24 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:29.450561 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=56 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:29.454152 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:29.454671 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:29.461036 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:29.467854 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:29.467854 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:29.467854 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:29.488124 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:19:29.673643 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [3b5d2770-0358-4836-b73c-0550f0324b3d] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:19:30.683013 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [3b5d2770-0358-4836-b73c-0550f0324b3d] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59552. May 25 15:19:30.773055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-af523763-66cc-4f07-883f-20d3b653b667 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 204 len: 0 microversion: 2.1 time: 1.325812 May 25 15:19:30.773648 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 665/1273] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:19:29 2022] DELETE /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 0 bytes in 1327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:19:30.781046 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aadaa76d-ba8d-4b5b-928f-a5a1a19192f4] AMQP server on 10.222.0.74:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 25 15:19:30.782084 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:30.783124 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=60 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:30.788378 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:30.789106 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:30.795832 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:30.796283 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:30.797075 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:30.797515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:31.016890 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:31.024745 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-12fec48e-2609-4587-970b-8ebdbb2568ed tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1575 microversion: 2.1 time: 0.245798 May 25 15:19:31.025319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 609/1274] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:30 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:19:32.052513 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:32.053817 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:32.065936 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:32.066446 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:32.067481 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:32.067961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:32.238263 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:32.247196 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-e0c346c6-45a9-4f9a-8dce-40f587d7e589 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1575 microversion: 2.1 time: 0.198993 May 25 15:19:32.247844 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 666/1275] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:32 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:33.265548 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:33.266285 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:33.274194 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:33.274672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:33.275486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:33.275909 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:33.294001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] [aadaa76d-ba8d-4b5b-928f-a5a1a19192f4] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59564. May 25 15:19:33.435697 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:33.445506 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-1764e866-9825-4802-aa20-1b234e2a7477 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1575 microversion: 2.1 time: 0.184363 May 25 15:19:33.446328 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 610/1276] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:33 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:33.787429 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-8b600f45-1821-46fb-b7bd-7137997594a4 req-679edb7b-228d-4198-8055-95857af4baa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15e8f6d-219f-4312-8be2-fd99185b1fb7", "name": "network-vif-deleted", "tag": "c7d42b86-c989-4645-bc89-66cc727cc05e"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:19:33.797457 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8b600f45-1821-46fb-b7bd-7137997594a4 req-679edb7b-228d-4198-8055-95857af4baa6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:33.801761 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8b600f45-1821-46fb-b7bd-7137997594a4 req-679edb7b-228d-4198-8055-95857af4baa6 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:33.812455 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-8b600f45-1821-46fb-b7bd-7137997594a4 req-679edb7b-228d-4198-8055-95857af4baa6 service nova] Creating event network-vif-deleted:c7d42b86-c989-4645-bc89-66cc727cc05e for instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 on hv-cinder-83028 May 25 15:19:33.818733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-8b600f45-1821-46fb-b7bd-7137997594a4 req-679edb7b-228d-4198-8055-95857af4baa6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034740 May 25 15:19:33.823121 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 667/1277] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:19:34.464655 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:34.466945 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:34.474117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:34.474959 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:34.475920 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:34.476899 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:34.580455 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:34.592027 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-85944885-8f34-4569-b5f9-e8929b8fea6e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 200 len: 1224 microversion: 2.1 time: 0.132253 May 25 15:19:34.592727 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 611/1278] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:34 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:19:35.612467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:35.613321 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:35.619953 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:35.620403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:35.621182 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:35.622214 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:35.635779 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] HTTP exception thrown: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Request method failure captured: May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 HTTP/1.1 May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkhEurPa-Xk_zJG661zk3_U9WJ5CxGG1R5gQuhBG_1eplCZOc0Z8o1JB6Vf7rpfBh_xhdYjFuKSKKa96IDC2IncLYLhWPy5m4_o_qn8rCzxjMYC-IfExKMZZPAspTcRva_EjqPhUWIL3soIateFqRgDcpkpGuWBYOlE-kMnxhvNk02g May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:19:35.637462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}] May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-TestVolumeBootPattern-1404602314 May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-TestVolumeBootPattern-1404602314-project May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: d13d9b9d3e48455082a74eaa3f1b4f18 May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-TestVolumeBootPattern-1404602314-project May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:19:35.642558 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'a15e8f6d-219f-4312-8be2-fd99185b1fb7'} May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:19:35.644243 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:19:35.646595 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:19:35.649191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Returning 404 to user: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:19:35.649191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-72651d89-ace9-4b66-afad-07739836a2e6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 404 len: 111 microversion: 2.1 time: 0.031305 May 25 15:19:35.649191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 668/1279] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:35 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:19:35.689164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1924685115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1765953191", "security_groups": [{"name": "tempest-secgroup-smoke-1823770904"}], "block_device_mapping_v2": [{"uuid": "c3a5deb0-a24c-437e-8566-12203b3df1a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8b32613-7bd9-40e5-935b-b1d37f6ebd8a"}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:19:35.825214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] validate_networks() for [('f8b32613-7bd9-40e5-935b-b1d37f6ebd8a', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:19:36.545327 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:19:36.546080 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:19:36.547168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:19:36.548045 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:19:36.548654 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:19:36.560113 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:36.563345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:36.563345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:36.563345 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:36.582756 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:19:36.588152 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for user d13d9b9d3e48455082a74eaa3f1b4f18 and project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:19:36.657518 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:19:36.659636 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3a5deb0-a24c-437e-8566-12203b3df1a1',volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:19:37.054767 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fae2c3e5-2e6a-4108-bf01-47f7c9fe01e0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.369061 May 25 15:19:37.061778 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 612/1280] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:19:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:19:37.068055 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-d572f0c2-a388-4ed9-8148-91963d181cea tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:37.068945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-d572f0c2-a388-4ed9-8148-91963d181cea tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:37.138468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-d572f0c2-a388-4ed9-8148-91963d181cea tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:37.149316 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-d572f0c2-a388-4ed9-8148-91963d181cea tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1095 microversion: 2.1 time: 0.085407 May 25 15:19:37.150283 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 669/1281] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:37 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:38.168450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:38.169164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:38.175517 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:38.176610 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:38.177402 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:38.177893 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:38.251944 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:38.260197 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6b58b9a3-e640-4d9e-9d6f-95d1f15d9523 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1145 microversion: 2.1 time: 0.096098 May 25 15:19:38.260828 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 613/1282] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:38 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:38.635205 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:19:38.635948 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:19:39.278938 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:39.279540 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:39.287276 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:39.290521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:39.290521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:39.290521 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:39.392342 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:39.407590 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-be60cfe8-683a-4893-8ed2-8ff2b1649275 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1201 microversion: 2.1 time: 0.133120 May 25 15:19:39.410986 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 670/1283] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:39 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1201 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:40.434824 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:40.437701 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:40.445417 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:40.445923 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:40.446795 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:40.447257 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:40.645770 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:40.656775 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-d41b90b5-55b1-4802-8bbc-b5d9b33fc4f3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1279 microversion: 2.1 time: 0.226192 May 25 15:19:40.658436 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 614/1284] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:40 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:19:41.416551 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-8192bbd1-2dad-4a02-9310-b742af30c30c req-7921b494-356d-4722-b815-fe9817dea7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5", "tag": "933f5e37-e7ff-424b-a3e2-cd832a6ec38b"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:19:41.421686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8192bbd1-2dad-4a02-9310-b742af30c30c req-7921b494-356d-4722-b815-fe9817dea7ec service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:41.422591 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8192bbd1-2dad-4a02-9310-b742af30c30c req-7921b494-356d-4722-b815-fe9817dea7ec service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:41.445031 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-8192bbd1-2dad-4a02-9310-b742af30c30c req-7921b494-356d-4722-b815-fe9817dea7ec service nova] Creating event network-changed:933f5e37-e7ff-424b-a3e2-cd832a6ec38b for instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 on hv-cinder-83028 May 25 15:19:41.454792 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-8192bbd1-2dad-4a02-9310-b742af30c30c req-7921b494-356d-4722-b815-fe9817dea7ec service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053774 May 25 15:19:41.456145 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 671/1285] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:19:41.685651 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:41.686809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:41.694592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:41.695713 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:41.696595 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:41.697206 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:41.893559 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:41.901569 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-a1a42f00-32f8-431d-91a4-0c37871ebe6f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.220768 May 25 15:19:41.902164 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 615/1286] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:41 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:42.921326 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:42.922030 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:42.929320 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:42.929793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:42.930579 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:42.931077 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:43.089002 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:43.098163 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-189c5e2d-bba0-4db1-92a4-894bb23e3e7e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.181637 May 25 15:19:43.098772 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 672/1287] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:42 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:19:44.124465 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:44.125521 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:44.132298 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:44.132750 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:44.133529 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:44.133972 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:44.275513 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:44.284251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-981e6025-8b3e-4469-9882-fe720ad2006a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.164343 May 25 15:19:44.284836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 616/1288] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:44 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:45.147022 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:19:45.147657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:19:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:19:45.301962 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:45.302487 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:45.309499 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:45.309942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:45.310745 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:45.311186 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:45.446374 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:45.454134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-13003021-8dc0-438d-865f-fa87209c4fd0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.156105 May 25 15:19:45.454729 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 673/1289] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:45 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:46.472137 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:46.472762 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:46.481280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:46.481728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:46.482504 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:46.482967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:46.570387 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:46.596332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:46.628069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:46.633933 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-37f73367-0cc7-4c90-bc71-be62c0291ca6 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.165575 May 25 15:19:46.634524 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 617/1290] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:46 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:47.651295 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:47.656935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:47.656935 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:47.660740 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:47.661195 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:47.661993 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:47.662432 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:47.809375 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:47.817229 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-b628e217-27fe-4fc3-b24e-595909cdd384 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.169903 May 25 15:19:47.817816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 674/1291] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:47 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:48.836171 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:48.836794 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:48.844163 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:48.844611 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:48.845373 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:48.845803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:48.979924 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:48.988860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-58d8b878-02c5-41d8-97f8-54016c82469e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.156829 May 25 15:19:48.989448 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 618/1292] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:48 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:50.007159 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:50.007764 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:50.014977 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:50.015439 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:50.016223 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:50.016665 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:50.157216 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:50.165041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-15bdd86b-0421-4c83-92d1-7b8f7d183ae9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.162167 May 25 15:19:50.165617 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 675/1293] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:50 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:51.187063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:51.187769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:51.196287 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:51.196576 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:51.197389 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:51.197942 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:51.343545 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:51.352946 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4aab51e5-7a8e-4618-86a5-883c4783141d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.172146 May 25 15:19:51.353932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 619/1294] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:51 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:52.375324 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:52.376068 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:52.383070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:52.383534 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:52.384317 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:52.384757 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:52.520905 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:52.528906 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5c8ab733-ca13-462e-8653-cac65b1d52b8 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.158457 May 25 15:19:52.529468 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 676/1295] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:52 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:53.349787 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5", "name": "network-vif-plugged", "status": "completed", "tag": "933f5e37-e7ff-424b-a3e2-cd832a6ec38b"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:19:53.358617 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:53.361511 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:53.369995 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] Creating event network-vif-plugged:933f5e37-e7ff-424b-a3e2-cd832a6ec38b for instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 on hv-cinder-83028 May 25 15:19:53.374051 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR oslo.messaging._drivers.impl_rabbit [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] [752ee5ab-1ee2-4138-b53a-b629aa96fa0b] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:19:53.545803 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:53.546401 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:53.552548 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:53.553001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:53.554044 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:53.554485 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:53.683017 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:53.690584 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-82b58944-3766-4b15-940e-e0deaa12dc47 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.148905 May 25 15:19:53.691177 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 677/1296] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:53 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:19:54.381280 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] [752ee5ab-1ee2-4138-b53a-b629aa96fa0b] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59646. May 25 15:19:54.384625 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-c513d3ee-1798-4cd7-adff-8cb37dd12b80 req-993fb7dd-e68a-4119-b886-84067d881c4e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.102672 May 25 15:19:54.385237 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 620/1297] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:19:54.708389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:54.708950 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:54.715095 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:54.715547 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:54.716318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:54.716754 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:54.850146 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:54.858367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6757af4d-2c5d-4f3f-ad7c-3eebcaf8d5d0 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.153984 May 25 15:19:54.858988 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 678/1298] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:54 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:55.876242 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:55.876967 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:55.883385 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:55.883830 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:55.884608 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:55.885047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:56.033205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:56.040732 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4cad8635-2d98-4273-b1d1-d33e5d31ad3a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1267 microversion: 2.1 time: 0.169998 May 25 15:19:56.041329 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 621/1299] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:55 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:57.057560 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:57.058172 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:57.065250 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:57.065696 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:57.066459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:57.066912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:57.197773 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:57.205918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-6a28867a-dd41-4659-abbb-fc941be616e1 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1452 microversion: 2.1 time: 0.152225 May 25 15:19:57.206477 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 679/1300] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:57 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:57.222332 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:19:57.222986 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:19:57.229598 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:57.230051 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:57.231403 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:57.231840 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:57.366039 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:19:57.373809 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-30e6fe21-a94e-42a2-b8df-851ed916916d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1452 microversion: 2.1 time: 0.155336 May 25 15:19:57.374401 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 622/1301] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:19:57 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:19:59.585463 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-8bb2fe02-cdcd-433e-9fd4-d93a272c423c req-29c58c8f-c305-44f8-8728-a943eb292c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5", "tag": "933f5e37-e7ff-424b-a3e2-cd832a6ec38b"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:19:59.589556 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:59.594945 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8bb2fe02-cdcd-433e-9fd4-d93a272c423c req-29c58c8f-c305-44f8-8728-a943eb292c94 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:19:59.600949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-8bb2fe02-cdcd-433e-9fd4-d93a272c423c req-29c58c8f-c305-44f8-8728-a943eb292c94 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:19:59.600949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:59.607156 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-8bb2fe02-cdcd-433e-9fd4-d93a272c423c req-29c58c8f-c305-44f8-8728-a943eb292c94 service nova] Creating event network-changed:933f5e37-e7ff-424b-a3e2-cd832a6ec38b for instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 on hv-cinder-83028 May 25 15:19:59.612081 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-8bb2fe02-cdcd-433e-9fd4-d93a272c423c req-29c58c8f-c305-44f8-8728-a943eb292c94 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030300 May 25 15:19:59.612868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 680/1302] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:21:34.144791 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:21:34.145406 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:21:40.146503 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:21:40.147219 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:21:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:22:01.401292 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1682928689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1765953191", "security_groups": [{"name": "tempest-secgroup-smoke-1823770904"}], "block_device_mapping_v2": [{"uuid": "bc2ccefb-eaf6-4477-b974-ba752a4ac2a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f8b32613-7bd9-40e5-935b-b1d37f6ebd8a"}]}} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:22:01.410507 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:01.411223 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=76 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:01.595118 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.network.neutron [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] validate_networks() for [('f8b32613-7bd9-40e5-935b-b1d37f6ebd8a', None, None, None, None, None)] {{(pid=129907) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 15:22:02.032239 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Flavor limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 15:22:02.032675 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Image limits 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 15:22:02.033160 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Flavor pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 15:22:02.033581 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Image pref 0:0:0 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 15:22:02.034001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.virt.hardware [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 15:22:02.047747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:02.047747 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:02.048483 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:02.048951 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:02.067672 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 15:22:02.072564 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.quota [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Getting quotas for user d13d9b9d3e48455082a74eaa3f1b4f18 and project 9e5a54632992428ca774d47f3f20d6b9. Resources: {'instances', 'ram', 'cores'} {{(pid=129907) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 15:22:02.135621 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Going to run 1 instances... {{(pid=129907) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 15:22:02.139417 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc2ccefb-eaf6-4477-b974-ba752a4ac2a9',volume_size=None,volume_type=None)] {{(pid=129907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 15:22:02.607074 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4a99b8ed-23e6-4b3d-98e0-eaa8fc1fc3d2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.210280 May 25 15:22:02.607844 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 623/1303] 10.222.0.74 () {60 vars in 1146 bytes} [Wed May 25 15:22:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 15:22:02.616261 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46d68f95-866b-4760-b52b-cad7c19ba36a] AMQP server on 10.222.0.74:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 15:22:02.622256 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-ba3a76d3-1eba-475e-a520-6bfeebb3b979 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:02.623695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-ba3a76d3-1eba-475e-a520-6bfeebb3b979 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:02.747868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-ba3a76d3-1eba-475e-a520-6bfeebb3b979 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:02.755260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-ba3a76d3-1eba-475e-a520-6bfeebb3b979 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1095 microversion: 2.1 time: 0.140795 May 25 15:22:02.755837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 681/1304] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:02 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:03.774591 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:03.775563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:03.782047 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:03.782475 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:03.783314 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:03.783720 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:03.851842 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:03.861392 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-46aaca4c-ca03-4264-9190-9208773ba95e tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1145 microversion: 2.1 time: 0.091299 May 25 15:22:03.861978 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 624/1305] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:03 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:04.882327 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:04.883687 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:04.896704 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:04.901793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:04.901793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:04.901793 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:04.920431 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] [46d68f95-866b-4760-b52b-cad7c19ba36a] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59784. May 25 15:22:04.987411 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:04.997968 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-328847c2-b853-4dbd-b86c-577bc1cdd6c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1201 microversion: 2.1 time: 0.121589 May 25 15:22:05.007105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 682/1306] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:04 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1201 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:22:06.018337 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:06.019037 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:06.025695 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:06.026155 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:06.027586 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:06.028057 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:06.245925 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:06.257881 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-85cc629b-c7db-41bb-9d4a-0e94e033eb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1279 microversion: 2.1 time: 0.243243 May 25 15:22:06.258860 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 625/1307] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:06 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1279 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:07.279353 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:07.280462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:07.288472 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:07.289189 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:07.290238 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:07.290841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:07.473200 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:07.481962 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-52767f90-b142-4f2c-beaf-582e411ab246 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.208191 May 25 15:22:07.482567 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 683/1308] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:07 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:07.657362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-0e29fd7f-54f7-4ea7-9154-979a8d09ac37 req-5c3342a7-085b-4c2a-a094-10b4076e3947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5019b4-90ad-41c3-ac9d-e80606e15bd1", "tag": "e28a6b0c-dfea-4658-961a-a23f59e22b56"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:22:07.673109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-0e29fd7f-54f7-4ea7-9154-979a8d09ac37 req-5c3342a7-085b-4c2a-a094-10b4076e3947 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:07.674245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-0e29fd7f-54f7-4ea7-9154-979a8d09ac37 req-5c3342a7-085b-4c2a-a094-10b4076e3947 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:07.691836 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-0e29fd7f-54f7-4ea7-9154-979a8d09ac37 req-5c3342a7-085b-4c2a-a094-10b4076e3947 service nova] Creating event network-changed:e28a6b0c-dfea-4658-961a-a23f59e22b56 for instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 on hv-cinder-83028 May 25 15:22:07.700803 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-0e29fd7f-54f7-4ea7-9154-979a8d09ac37 req-5c3342a7-085b-4c2a-a094-10b4076e3947 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117368 May 25 15:22:07.701983 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 626/1309] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:22:08.511386 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:08.512653 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:08.522604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:08.523257 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:08.524264 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:08.524906 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:08.671867 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:08.680467 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-bb2b87dd-f758-4254-98cf-7b091f402436 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.176731 May 25 15:22:08.681060 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 684/1310] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:08 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:09.700052 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:09.700762 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:09.708023 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:09.708486 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:09.709271 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:09.709712 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:09.857267 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:09.865530 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-ab6be04e-857e-4094-aa99-44dd9bdcacd3 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.169647 May 25 15:22:09.866152 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 627/1311] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:09 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:10.882920 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:10.883808 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:10.890292 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:10.890802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:10.891604 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:10.892041 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:11.044134 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:11.052404 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-f062c607-ab91-45de-9031-a9dfc8438c56 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.173518 May 25 15:22:11.053001 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 685/1312] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:10 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:12.070949 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:12.071871 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:12.074752 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=2 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:12.080414 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:12.082034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:12.082034 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:12.082341 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:12.082813 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell0:SELECT=6 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:12.241153 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:12.249796 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-018e6c2d-2009-4955-bbca-fb850822f532 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.183833 May 25 15:22:12.250391 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 628/1313] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:12 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:13.267260 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:13.267922 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:13.270389 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell0:SELECT=2 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:13.275619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:13.276078 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:13.277433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:13.277868 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:13.428314 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:13.436367 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-eb519d04-ddc2-4f96-baa5-aace3214fb93 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.172992 May 25 15:22:13.436957 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 686/1314] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:13 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:14.453969 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:14.454620 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:14.461615 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:14.462067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:14.462904 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:14.463348 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:14.629250 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:14.637572 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-31e11195-4031-4839-9f32-d98a8a9bcd5f tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.187515 May 25 15:22:14.638166 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 629/1315] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:14 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:22:15.654984 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:15.655733 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:15.662422 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:15.662918 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:15.663738 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:15.664178 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:15.818532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:15.827737 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c3521527-b3fc-4bc1-b56b-3742e0231ae5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.176641 May 25 15:22:15.828553 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 687/1316] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:15 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:16.847535 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:16.848254 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:16.858067 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:16.858555 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:16.859765 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:16.860538 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:17.007570 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:17.015680 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-52573e4e-6596-4ad3-8e95-4b1fed8d9d71 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.173108 May 25 15:22:17.016273 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 630/1317] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:16 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:18.032909 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:18.033690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:18.040518 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:18.040980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:18.041816 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:18.042810 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:18.191802 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:18.201543 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-57c7f266-fe8a-4bf4-be18-5c7104bce739 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.172461 May 25 15:22:18.202144 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 688/1318] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:18 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:19.218533 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:19.219168 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:19.225866 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:19.226311 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:19.227114 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:19.227545 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:19.381556 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:19.390449 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-db82c6e9-3bd3-4d4d-b865-06f0de7f1a1a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.176425 May 25 15:22:19.391235 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 631/1319] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:19 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:19.955690 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-a7dd0b26-df45-4c75-93c4-233f7ec13331 req-61f19fa7-32ec-4860-b2e6-f4bb42a3863b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5019b4-90ad-41c3-ac9d-e80606e15bd1", "name": "network-vif-plugged", "status": "completed", "tag": "e28a6b0c-dfea-4658-961a-a23f59e22b56"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:22:19.965115 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-a7dd0b26-df45-4c75-93c4-233f7ec13331 req-61f19fa7-32ec-4860-b2e6-f4bb42a3863b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:19.965619 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-a7dd0b26-df45-4c75-93c4-233f7ec13331 req-61f19fa7-32ec-4860-b2e6-f4bb42a3863b service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:19.977287 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-a7dd0b26-df45-4c75-93c4-233f7ec13331 req-61f19fa7-32ec-4860-b2e6-f4bb42a3863b service nova] Creating event network-vif-plugged:e28a6b0c-dfea-4658-961a-a23f59e22b56 for instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 on hv-cinder-83028 May 25 15:22:19.983527 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-a7dd0b26-df45-4c75-93c4-233f7ec13331 req-61f19fa7-32ec-4860-b2e6-f4bb42a3863b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 May 25 15:22:19.984204 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 689/1320] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:22:20.410381 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:20.411122 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:20.419650 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:20.420241 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:20.421243 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:20.421725 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:20.583358 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:20.592393 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-fe374424-2d39-4c1d-8b78-bf3adeace180 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.186791 May 25 15:22:20.592984 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 632/1321] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:20 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 15:22:21.617247 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:21.617891 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:21.624747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:21.625203 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:21.625994 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:21.626433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:21.774385 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:21.782542 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5e3a6045-e7d7-4170-b8e4-e53a94befd2a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1267 microversion: 2.1 time: 0.170192 May 25 15:22:21.783167 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 690/1322] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:21 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:22.801309 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:22.802185 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:22.809357 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:22.809805 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:22.810596 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:22.811050 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:22.952299 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:22.960214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-015e38b8-52a6-487c-84d5-5ab893d249d5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1453 microversion: 2.1 time: 0.162986 May 25 15:22:22.960794 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 633/1323] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:22 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:22.976564 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:22:22.977164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:22:22.983969 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:22.984416 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:22.985195 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:22.987258 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:23.123942 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:22:23.131746 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-605af357-e3af-4d36-81f4-d3748b1dae4a tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1453 microversion: 2.1 time: 0.159327 May 25 15:22:23.132328 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 691/1324] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:22:22 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:22:25.473335 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-9e1754e1-2058-46eb-aa5b-c702ee32d5e9 req-5cd3a4a6-1dd8-4e6d-9c73-0a305657f8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5019b4-90ad-41c3-ac9d-e80606e15bd1", "tag": "e28a6b0c-dfea-4658-961a-a23f59e22b56"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:22:25.484223 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-9e1754e1-2058-46eb-aa5b-c702ee32d5e9 req-5cd3a4a6-1dd8-4e6d-9c73-0a305657f8c5 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:22:25.484764 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-9e1754e1-2058-46eb-aa5b-c702ee32d5e9 req-5cd3a4a6-1dd8-4e6d-9c73-0a305657f8c5 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:22:25.499973 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-9e1754e1-2058-46eb-aa5b-c702ee32d5e9 req-5cd3a4a6-1dd8-4e6d-9c73-0a305657f8c5 service nova] Creating event network-changed:e28a6b0c-dfea-4658-961a-a23f59e22b56 for instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 on hv-cinder-83028 May 25 15:22:25.506435 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-9e1754e1-2058-46eb-aa5b-c702ee32d5e9 req-5cd3a4a6-1dd8-4e6d-9c73-0a305657f8c5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037090 May 25 15:22:25.507582 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 634/1325] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:22:58.645498 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:22:58.646137 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:23:05.156462 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:23:05.157226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:24:25.686370 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_api:SELECT=25 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:25.687209 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG dbcounter [-] [129908] Writing DB stats nova_cell1:SELECT=57 {{(pid=129908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:25.689214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aadaa76d-ba8d-4b5b-928f-a5a1a19192f4] AMQP server on 10.222.0.74:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 25 15:24:25.690494 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:25.691260 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG dbcounter [-] [129907] Writing DB stats nova_cell1:SELECT=60 {{(pid=129907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:25.692433 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:25.692949 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:25.697231 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-05e7ac4a-92b0-4fff-b34b-4594410aa8a0 req-fbc3af73-1a90-47c9-bb4b-c3cd452b33ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5019b4-90ad-41c3-ac9d-e80606e15bd1", "tag": "e28a6b0c-dfea-4658-961a-a23f59e22b56"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:24:25.699403 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:25.699857 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:25.700652 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:25.701091 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:25.707568 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-05e7ac4a-92b0-4fff-b34b-4594410aa8a0 req-fbc3af73-1a90-47c9-bb4b-c3cd452b33ca service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:25.708100 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-05e7ac4a-92b0-4fff-b34b-4594410aa8a0 req-fbc3af73-1a90-47c9-bb4b-c3cd452b33ca service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:25.720873 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-05e7ac4a-92b0-4fff-b34b-4594410aa8a0 req-fbc3af73-1a90-47c9-bb4b-c3cd452b33ca service nova] Creating event network-changed:e28a6b0c-dfea-4658-961a-a23f59e22b56 for instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 on hv-cinder-83028 May 25 15:24:25.726510 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-05e7ac4a-92b0-4fff-b34b-4594410aa8a0 req-fbc3af73-1a90-47c9-bb4b-c3cd452b33ca service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039644 May 25 15:24:25.728158 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 635/1326] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:24:25.730736 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:24:26.034976 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1886c8b6-d0e6-48b8-a661-fc1f4e6a81e9 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "DELETE /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 204 len: 0 microversion: 2.1 time: 0.350497 May 25 15:24:26.035593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 692/1327] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:24:25 2022] DELETE /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:24:26.044839 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:26.045632 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:26.055424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:26.055424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:26.055424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:26.055424 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:26.204657 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:26.212466 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-6615a0c1-1164-4d4c-a86f-f63e9dfae791 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1578 microversion: 2.1 time: 0.172497 May 25 15:24:26.213063 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 636/1328] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:26 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:27.231372 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:27.232070 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:27.238226 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:27.238695 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:27.239458 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:27.239892 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:27.374191 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:27.381888 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-3a28893b-9dc6-46ef-934e-902891a21adf tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1578 microversion: 2.1 time: 0.154638 May 25 15:24:27.382465 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 693/1329] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:27 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:28.401515 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:28.402705 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:28.402869 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-ac1e9166-5cfc-46ec-ab55-0327891a4895 req-4ac8337d-63d6-426d-8113-985a7c7b4395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5019b4-90ad-41c3-ac9d-e80606e15bd1", "name": "network-vif-deleted", "tag": "e28a6b0c-dfea-4658-961a-a23f59e22b56"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:24:28.410825 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:28.411251 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:28.411531 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ac1e9166-5cfc-46ec-ab55-0327891a4895 req-4ac8337d-63d6-426d-8113-985a7c7b4395 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:28.411980 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-ac1e9166-5cfc-46ec-ab55-0327891a4895 req-4ac8337d-63d6-426d-8113-985a7c7b4395 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:28.412103 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:28.412583 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:28.423395 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-ac1e9166-5cfc-46ec-ab55-0327891a4895 req-4ac8337d-63d6-426d-8113-985a7c7b4395 service nova] Creating event network-vif-deleted:e28a6b0c-dfea-4658-961a-a23f59e22b56 for instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 on hv-cinder-83028 May 25 15:24:28.428785 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-ac1e9166-5cfc-46ec-ab55-0327891a4895 req-4ac8337d-63d6-426d-8113-985a7c7b4395 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030152 May 25 15:24:28.429048 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] [aadaa76d-ba8d-4b5b-928f-a5a1a19192f4] Reconnected to AMQP server on 10.222.0.74:5672 via [amqp] client with port 59890. May 25 15:24:28.429613 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 694/1330] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:24:28.479214 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:28.486999 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-9306eafe-ff69-4852-9149-a4f58d1db946 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1391 microversion: 2.1 time: 0.091177 May 25 15:24:28.487563 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 637/1331] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:28 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1391 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:29.504896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:29.505589 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:29.512300 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:29.512751 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:29.513532 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:29.513987 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:29.546657 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:29.547174 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:29.547631 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lazy-loading 'fault' on Instance uuid fa5019b4-90ad-41c3-ac9d-e80606e15bd1 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:24:29.589286 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:29.597197 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1ef1ab22-b7cd-4d09-a862-9735e83ab8f5 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 200 len: 1231 microversion: 2.1 time: 0.096900 May 25 15:24:29.597771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 695/1332] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:29 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:30.615073 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:30.615644 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: fa5019b4-90ad-41c3-ac9d-e80606e15bd1] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:30.622779 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:30.623231 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:30.624001 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:30.624443 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:30.638245 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] HTTP exception thrown: Instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 could not be found. May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Request method failure captured: May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 HTTP/1.1 May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkhEurPa-Xk_zJG661zk3_U9WJ5CxGG1R5gQuhBG_1eplCZOc0Z8o1JB6Vf7rpfBh_xhdYjFuKSKKa96IDC2IncLYLhWPy5m4_o_qn8rCzxjMYC-IfExKMZZPAspTcRva_EjqPhUWIL3soIateFqRgDcpkpGuWBYOlE-kMnxhvNk02g May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:24:30.639914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}] May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: d13d9b9d3e48455082a74eaa3f1b4f18 May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 could not be found. May 25 15:24:30.641769 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': 'fa5019b4-90ad-41c3-ac9d-e80606e15bd1'} May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 could not be found. May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:24:30.643017 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 could not be found. May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 could not be found. May 25 15:24:30.644728 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:30.646394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Returning 404 to user: Instance fa5019b4-90ad-41c3-ac9d-e80606e15bd1 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:24:30.646394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-772aa1c3-03c5-43a8-a5a5-cc05b347f3c2 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1" status: 404 len: 111 microversion: 2.1 time: 0.030345 May 25 15:24:30.646394 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 638/1333] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:30 2022] GET /compute/v2.1/servers/fa5019b4-90ad-41c3-ac9d-e80606e15bd1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:24:34.048555 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:34.049121 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:34.050462 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [req-e1ca2adf-ae94-4376-bcf5-376d7ad5d0cc req-c9563bd8-8b9b-48ed-ab47-c7b7cecfaea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5", "tag": "933f5e37-e7ff-424b-a3e2-cd832a6ec38b"}]} {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:24:34.056436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:34.056974 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:34.057834 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:34.058333 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:34.059386 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e1ca2adf-ae94-4376-bcf5-376d7ad5d0cc req-c9563bd8-8b9b-48ed-ab47-c7b7cecfaea4 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:34.060069 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [req-e1ca2adf-ae94-4376-bcf5-376d7ad5d0cc req-c9563bd8-8b9b-48ed-ab47-c7b7cecfaea4 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:34.072117 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.compute.server_external_events [req-e1ca2adf-ae94-4376-bcf5-376d7ad5d0cc req-c9563bd8-8b9b-48ed-ab47-c7b7cecfaea4 service nova] Creating event network-changed:933f5e37-e7ff-424b-a3e2-cd832a6ec38b for instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 on hv-cinder-83028 May 25 15:24:34.077575 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [req-e1ca2adf-ae94-4376-bcf5-376d7ad5d0cc req-c9563bd8-8b9b-48ed-ab47-c7b7cecfaea4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030936 May 25 15:24:34.078537 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 639/1334] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 15:24:34.088621 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Going to try to terminate instance {{(pid=129908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 15:24:34.387896 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-5c81c851-9308-4019-8953-62fb11e93f5d tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 204 len: 0 microversion: 2.1 time: 0.343035 May 25 15:24:34.391655 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 696/1335] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:24:34 2022] DELETE /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 15:24:34.398098 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:34.399083 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:34.419817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:34.420301 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:34.421270 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:34.421776 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:34.561905 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:34.569690 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-b9f99c98-28c4-4997-ad82-4733e2592757 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1576 microversion: 2.1 time: 0.176220 May 25 15:24:34.571108 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 640/1336] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:34 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:35.588255 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:35.588866 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:35.595105 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:35.595554 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:35.596318 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:35.596747 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:35.734444 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:35.743154 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-1d8030a9-70cf-4532-932b-c61d263e42cb tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1576 microversion: 2.1 time: 0.159085 May 25 15:24:35.744142 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 697/1337] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:35 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:36.760870 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:36.761458 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:36.768649 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:36.769109 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:36.769885 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:36.770707 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:36.771436 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [req-19522476-a462-40f5-a53c-af081e6a73f8 req-2c7db1c8-921c-4314-98a1-b04916e58b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5", "name": "network-vif-deleted", "tag": "933f5e37-e7ff-424b-a3e2-cd832a6ec38b"}]} {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 15:24:36.781912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-19522476-a462-40f5-a53c-af081e6a73f8 req-2c7db1c8-921c-4314-98a1-b04916e58b40 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:36.781912 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [req-19522476-a462-40f5-a53c-af081e6a73f8 req-2c7db1c8-921c-4314-98a1-b04916e58b40 service nova] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:36.792693 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.compute.server_external_events [req-19522476-a462-40f5-a53c-af081e6a73f8 req-2c7db1c8-921c-4314-98a1-b04916e58b40 service nova] Creating event network-vif-deleted:933f5e37-e7ff-424b-a3e2-cd832a6ec38b for instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 on hv-cinder-83028 May 25 15:24:36.797593 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [req-19522476-a462-40f5-a53c-af081e6a73f8 req-2c7db1c8-921c-4314-98a1-b04916e58b40 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030511 May 25 15:24:36.798185 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 698/1338] 10.222.0.74 () {64 vars in 1317 bytes} [Wed May 25 15:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:24:36.835829 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.policy [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129907) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:36.844841 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-4deafc41-f17a-4b03-9c20-298b3a97c6ce tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1390 microversion: 2.1 time: 0.088323 May 25 15:24:36.845416 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 641/1339] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:36 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:37.862525 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:37.863164 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:37.869459 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:37.869904 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:37.870686 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:37.871119 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:37.902841 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:37.903301 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:37.903771 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.objects.instance [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lazy-loading 'fault' on Instance uuid e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 {{(pid=129908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 15:24:37.950739 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.policy [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13d9b9d3e48455082a74eaa3f1b4f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5a54632992428ca774d47f3f20d6b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129908) authorize /opt/stack/nova/nova/policy.py:199}} May 25 15:24:37.958325 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-8cef3561-3fc0-40dc-95f6-268bdf9a92e7 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 200 len: 1231 microversion: 2.1 time: 0.100495 May 25 15:24:37.958928 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 699/1340] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:37 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 15:24:38.975005 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:38.975592 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:38.982319 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:38.982795 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:38.983589 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:38.984022 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:38.997457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] HTTP exception thrown: Instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 could not be found. May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Request method failure captured: May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 HTTP/1.1 May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkhEurPa-Xk_zJG661zk3_U9WJ5CxGG1R5gQuhBG_1eplCZOc0Z8o1JB6Vf7rpfBh_xhdYjFuKSKKa96IDC2IncLYLhWPy5m4_o_qn8rCzxjMYC-IfExKMZZPAspTcRva_EjqPhUWIL3soIateFqRgDcpkpGuWBYOlE-kMnxhvNk02g May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:24:38.999120 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}] May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: d13d9b9d3e48455082a74eaa3f1b4f18 May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 could not be found. May 25 15:24:39.000855 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': 'e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5'} May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 could not be found. May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:24:39.002055 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 could not be found. May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 could not be found. May 25 15:24:39.003763 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.005362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Returning 404 to user: Instance e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:24:39.005362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-21aeef67-6008-473f-82ec-502d8d20ab99 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5" status: 404 len: 111 microversion: 2.1 time: 0.029484 May 25 15:24:39.005362 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 642/1341] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:38 2022] GET /compute/v2.1/servers/e1e802cf-b4f1-425b-ac0c-4ac1b36fe5e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:24:39.519284 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:39.519837 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.compute.api [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129908) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:39.526309 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:39.526794 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:39.527569 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:39.528005 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG oslo_concurrency.lockutils [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:39.540961 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.wsgi [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] HTTP exception thrown: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Request method failure captured: May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: request: DELETE /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 HTTP/1.1 May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept: application/json May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Accept-Encoding: identity May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Connection: close May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Length: 0 May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Content-Type: application/json May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Host: 10.222.0.74 May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Openstack-System-Scope: None May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: User-Agent: python-urllib3/1.26.9 May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Auth-Token: gAAAAABijkhEurPa-Xk_zJG661zk3_U9WJ5CxGG1R5gQuhBG_1eplCZOc0Z8o1JB6Vf7rpfBh_xhdYjFuKSKKa96IDC2IncLYLhWPy5m4_o_qn8rCzxjMYC-IfExKMZZPAspTcRva_EjqPhUWIL3soIateFqRgDcpkpGuWBYOlE-kMnxhvNk02g May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Id: None May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Domain-Name: None May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Identity-Status: Confirmed May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Is-Admin-Project: True May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Id: default May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Domain-Name: Default May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Project-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Role: member,reader May 25 15:24:39.542597 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Roles: member,reader May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}] May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Id: default May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Domain-Name: Default May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Id: d13d9b9d3e48455082a74eaa3f1b4f18 May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: X-User-Name: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: method: > May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: exception: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.544417 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: action_args: {'id': 'a15e8f6d-219f-4312-8be2-fd99185b1fb7'} May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:24:39.545571 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.547460 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: ERROR nova.api.openstack.wsgi May 25 15:24:39.549456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Returning 404 to user: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. {{(pid=129908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:24:39.549456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-32623fca-e448-4670-b038-caf69732db03 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 404 len: 111 microversion: 2.1 time: 0.028663 May 25 15:24:39.549456 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 700/1342] 10.222.0.74 () {58 vars in 1238 bytes} [Wed May 25 15:24:39 2022] DELETE /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:24:39.553058 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '>' {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:39.557717 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.compute.api [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] [instance: a15e8f6d-219f-4312-8be2-fd99185b1fb7] Fetching instance by UUID {{(pid=129907) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 15:24:39.560262 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:39.560714 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:39.561488 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:24:39.561932 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG oslo_concurrency.lockutils [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Lock "dfbdcb43-9801-4e51-9697-8ab17efd22ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:24:39.575852 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.wsgi [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] HTTP exception thrown: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Request method failure captured: May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: request: GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 HTTP/1.1 May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept: application/json May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Accept-Encoding: identity May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Connection: close May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Length: 0 May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Content-Type: application/json May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Host: 10.222.0.74 May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Openstack-System-Scope: None May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: User-Agent: python-urllib3/1.26.9 May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Auth-Token: gAAAAABijkhEurPa-Xk_zJG661zk3_U9WJ5CxGG1R5gQuhBG_1eplCZOc0Z8o1JB6Vf7rpfBh_xhdYjFuKSKKa96IDC2IncLYLhWPy5m4_o_qn8rCzxjMYC-IfExKMZZPAspTcRva_EjqPhUWIL3soIateFqRgDcpkpGuWBYOlE-kMnxhvNk02g May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Id: None May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Domain-Name: None May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Identity-Status: Confirmed May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Is-Admin-Project: True May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Id: default May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Domain-Name: Default May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Project-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Role: member,reader May 25 15:24:39.578012 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Roles: member,reader May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/9e5a54632992428ca774d47f3f20d6b9"}]}] May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Id: 9e5a54632992428ca774d47f3f20d6b9 May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-Tenant-Name: tempest-TestVolumeBootPattern-1404602314 May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Id: default May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Domain-Name: Default May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Id: d13d9b9d3e48455082a74eaa3f1b4f18 May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: X-User-Name: tempest-TestVolumeBootPattern-1404602314-project May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: method: > May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: exception: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.579815 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: action_args: {'id': 'a15e8f6d-219f-4312-8be2-fd99185b1fb7'} May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: {{(pid=129907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 15:24:39.580817 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. May 25 15:24:39.582450 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: ERROR nova.api.openstack.wsgi May 25 15:24:39.584033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: DEBUG nova.api.openstack.wsgi [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Returning 404 to user: Instance a15e8f6d-219f-4312-8be2-fd99185b1fb7 could not be found. {{(pid=129907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 15:24:39.584033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO nova.api.openstack.requestlog [None req-8dcbf53a-93fa-472a-adb4-a02f06b70450 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7" status: 404 len: 111 microversion: 2.1 time: 0.030519 May 25 15:24:39.584033 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: [pid: 129907|app: 0|req: 643/1343] 10.222.0.74 () {58 vars in 1235 bytes} [Wed May 25 15:24:39 2022] GET /compute/v2.1/servers/a15e8f6d-219f-4312-8be2-fd99185b1fb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 15:24:41.180859 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: DEBUG nova.api.openstack.wsgi [None req-c9d94cdf-a5c5-40fd-a1b2-715ac2abc927 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] Calling method '.version_select at 0x7f6fb993de50>' {{(pid=129908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:24:41.270501 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO nova.api.openstack.requestlog [None req-c9d94cdf-a5c5-40fd-a1b2-715ac2abc927 tempest-TestVolumeBootPattern-1404602314 tempest-TestVolumeBootPattern-1404602314-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1765953191" status: 202 len: 0 microversion: 2.1 time: 0.093741 May 25 15:24:41.271112 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: [pid: 129908|app: 0|req: 701/1344] 10.222.0.74 () {58 vars in 1262 bytes} [Wed May 25 15:24:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1765953191 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 15:24:54.155828 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:24:54.156457 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:24:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:25:00.155205 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:25:00.155914 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:26:18.654929 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:26:18.655762 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:27:04.902921 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:27:04.903558 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:28:14.164136 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:28:14.164931 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:28:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:28:20.163802 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:28:20.164461 dv-cinder-830283-3-iscsi devstack@n-api.service[129907]: Wed May 25 15:28:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:29:38.663281 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:29:38.663811 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:29:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:29:45.169061 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:29:45.169782 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 15:30:02.281734 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 15:30:02.282524 dv-cinder-830283-3-iscsi devstack@n-api.service[129908]: Wed May 25 15:30:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!